Held in conjunction with KDD'24 Aug 25, 2024 - Aug 29, 2024, Barcelona, Spain
The objective of this workshop is to discuss the winning solutions of the Amazon KDD Cup 2024: A Multi-task Online Shopping Challenge for LLMs. In this challenge, we introduce the Shopping MMLU dataset, a collection of questions written in natural language
covering various aspects of knowledge in online shopping: Shopping Concept Understanding, Shopping Knowledge Reasoning, User Behavior Alignment, and Multi-lingual Abilities. The challenge is hosted with the aim of encouraging the development of a new paradigm
to incorporate deep learning into online shopping --- conversational online shopping with LLMs. In this way, a versatile LLM, instead of task-specific models, is trained for a broad range of online shopping tasks to reduce task-specific engineering efforts.
In addition, such an LLM can act as an interactive shop assistant that can provide real-time feedback to customer questions. More details of this challenge are available here: [Challenge Link] and [OpenReview Link]
August 28, 2024, 11:00AM–16:30PM (CEST), Barcelona, Spain.
Centre de Convencions Internacional de Barcelona
This will be a hybrid session. Zoom link will be provided later.
Introduction by organizers.
Moderator: Yilun Jin, Ph.D. Student at Hong Kong University of Science and Technology
Speaker: Dr. Zheng Li, Senior Applied Scientist at Amazon
The objective of this workshop is to discuss the winning submissions of the Amazon KDD Cup 2024: Multi-task Online Shopping Challenge for LLMs.
Submissions to the workshop are single-blind (author names and affiliations should be listed).
A team will have a guaranteed opportunity for an in-person oral/poster presentation if the team ranks in top-5 in any one of the 5 tracks.
Other submissions will be evaluated by a committee based on their novelty and insights.
The deadline for the submissions is August 2, 2024 August 4, 2024 (Anywhere on Earth time).
Accepted submissions will be notified latest by August 6, 2024.
Please note that the KDD Cup workshop will have no proceedings and the authors retain full rights to submit or post the paper at any other venue.
Link to the submission website: https://openreview.net/group?id=KDD.org/2024/Workshop/Amazon_KDD_Cup
\documentclass[sigconf, review]{acmart}
.
Template guidelines are here: https://www.acm.org/publications/proceedings-template.
In addition, authors can provide an optional one page supplement at the end of their submitted paper (it needs to be in the same PDF file) focused on reproducibility. After the submission deadline, the names and order of authors cannot be changed.
Our dataset paper is available at ArXiv, and the Shopping MMLU dataset is available at github. Please cite our paper if you find our work helpful.
Link to the submission website: https://openreview.net/group?id=KDD.org/2024/Workshop/Amazon_KDD_Cup
The data and its license is available at github.
If you plan to use this dataset for your own research, please cite this paper.
@article{jin2024shopping,
title={Shopping MMLU: A Massive Multi-Task Online Shopping Benchmark for Large Language Models},
author={Jin, Yilun and Li, Zheng and Zhang, Chenwei and Cao, Tianyu and Gao, Yifan and Jayarao, Pratik and Li, Mao and Liu, Xin and Sarkhel, Ritesh and Tang, Xianfeng and others},
journal={arXiv preprint arXiv:2410.20745},
year={2024}
}