Applications of LLMs in E-Commerce Search and Product Knowledge Graph: The DoorDash Case Study | Proceedings of the 17th ACM International Conference on Web Search and Data Mining (2024)

abstract

Authors: Sudeep Das, Raghav Saboo, Chaitanya S. K. Vadrevu, Bruce Wang, and Steven Xu

WSDM '24: Proceedings of the 17th ACM International Conference on Web Search and Data Mining

March 2024

Pages 1163 - 1164

Published: 04 March 2024 Publication History

  • 0citation
  • 175
  • Downloads

Metrics

Total Citations0Total Downloads175

Last 12 Months175

Last 6 weeks39

  • Get Citation Alerts

    New Citation Alert added!

    This alert has been successfully added and will be sent to:

    You will be notified whenever a record that you have chosen has been cited.

    To manage your alert preferences, click on the button below.

    Manage my Alerts

    New Citation Alert!

    Please log in to your account

  • Get Access

      • Get Access
      • References
      • Media
      • Tables
      • Share

    Abstract

    Extracting knowledge from unstructured or semi-structured textual information is essential for the machine learning applications that power DoorDash's search experience, and the development and maintenance of its product knowledge graph. Large language models (LLMs) have opened up new possibilities for utilizing their power in these areas, replacing or complementing traditional natural language processing methods. LLMs are also proving to be useful in the label and annotation generation process, which is critical for these use cases. In this talk, we will provide a high-level overview of how we incorporated LLMs for search relevance and product understanding use cases, as well as the key lessons learned and challenges faced during their practical implementation.

    References

    [1]

    Alexander Brinkmann, Roee Shraga, Reng Chiz Der, and Christian Bizer. 2023. Product Information Extraction using ChatGPT. arXiv preprint arXiv:2304.10428 (2023).

    [2]

    Fabrizio Gilardi, Meysam Alizadeh, and Maël Kubli. 2023. ChatGPT outperforms crowd workers for text-annotation tasks Proceedings of the National Academy of Sciences 120, 30 (jul 2023). https://doi.org/10.1073/pnas.2305016120

    [3]

    Philipp Moritz, Robert Nishihara, Stephanie Wang, Alexey Tumanov, Richard Liaw, Eric Liang, Melih Elibol, Zongheng Yang, William Paul, Michael I. Jordan, and Ion Stoica. 2018. Ray: A Distributed Framework for Emerging AI Applications. arXiv preprint arXiv:1712.05889 (2018).

    [4]

    Tao Shen, Guodong Long, Xiubo Geng, Chongyang Tao, Tianyi Zhou, and Daxin Jiang. 2023. Large Language Models are Strong Zero-Shot Retriever. arXiv preprint arXiv:2304.14233 (2023).

    [5]

    Senbao Shi, Zhenran Xu, Baotian Hu, and Min zhang. 2023. Generative Multimodal Entity Linking. arXiv preprint arXiv:2306.12725 (2023).

    [6]

    Khanin Sisaengsuwanchai, Navapat Nananukul, and Mayank Kejriwal. 2023. How does prompt engineering affect ChatGPT performance on unsupervised entity resolution? arXiv preprint arXiv:2310.06174 (2023).

    [7]

    Krishna Srinivasan, Karthik Raman, Anupam Samanta, Lingrui Liao, Luca Bertelli, and Mike Bendersky. 2022. QUILL: Query Intent with Large Language Models using Retrieval Augmentation and Multi-stage Distillation. arXiv preprint arXiv:2210.15718 (2022).

    [8]

    Shuhe Wang, Xiaofei Sun, Xiaoya Li, Rongbin Ouyang, Fei Wu, Tianwei Zhang, Jiwei Li, and Guoyin Wang. 2023. GPT-NER: Named Entity Recognition via Large Language Models. arXiv preprint arXiv:2304.10428 (2023).

    Index Terms

    1. Applications of LLMs in E-Commerce Search and Product Knowledge Graph: The DoorDash Case Study

      1. Computing methodologies

          1. Knowledge representation and reasoning

            1. Natural language processing

              1. Information extraction

            2. Machine learning

          Recommendations

          • Can we Soft Prompt LLMs for Graph Learning Tasks?

            WWW '24: Companion Proceedings of the ACM on Web Conference 2024

            Graph plays an important role in representing complex relationships in real-world applications such as social networks, biological data and citation networks. In recent years, Large Language Models (LLMs) have achieved tremendous success in various ...

            Read More

          • Depth-First Search and Linear Graph Algorithms

            The value of depth-first search or “backtracking” as a technique for solving problems is illustrated by two examples. An improved version of an algorithm for finding the strongly connected components of a directed graph and at algorithm for finding the ...

            Read More

          • Knowledge-Based Search in Competitive Domains

            Artificial Intelligence programs operating in competitive domains typically use brute-force search if the domain can be modeled using a search tree or alternately use nonsearch heuristics as in production rule-based expert systems. While brute-force ...

            Read More

          Comments

          Information & Contributors

          Information

          Published In

          Applications of LLMs in E-Commerce Search and Product Knowledge Graph: The DoorDash Case Study | Proceedings of the 17th ACM International Conference on Web Search and Data Mining (6)

          WSDM '24: Proceedings of the 17th ACM International Conference on Web Search and Data Mining

          March 2024

          1246 pages

          ISBN:9798400703713

          DOI:10.1145/3616855

          • General Chairs:
          • Luz Angélica

            Caudillo Mata (MDA Geointelligence)

            ,
          • Silvio Lattanzi

            Google Research

            ,
          • Andrés Muñoz Medina

            Google Research

            ,
          • Program Chairs:
          • Leman Akoglu

            CMU

            ,
          • Aristides Gionis

            KTH

            ,
          • Sergei Vassilvitskii

            Google Research

          Copyright © 2024 Owner/Author.

          Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

          Sponsors

          • SIGMOD: ACM Special Interest Group on Management of Data
          • SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web
          • SIGKDD: ACM Special Interest Group on Knowledge Discovery in Data
          • SIGIR: ACM Special Interest Group on Information Retrieval

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 04 March 2024

          Check for updates

          Author Tags

          1. large language model
          2. natural language processing
          3. product knowledge graph
          4. search

          Qualifiers

          • Abstract

          Conference

          WSDM '24

          Sponsor:

          • SIGMOD
          • SIGWEB
          • SIGKDD
          • SIGIR

          Acceptance Rates

          Overall Acceptance Rate 498 of 2,863 submissions, 17%

          Upcoming Conference

          WSDM '25

          • Sponsor:
          • sigir
          • sigir
          • sigir
          • sigir

          The Eighteenth ACM International Conference on Web Search and Data Mining

          April 7 - 11, 2025

          Hannover , Germany

          Contributors

          Applications of LLMs in E-Commerce Search and Product Knowledge Graph: The DoorDash Case Study | Proceedings of the 17th ACM International Conference on Web Search and Data Mining (13)

          Other Metrics

          View Article Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Total Citations

          • 175

            Total Downloads

          • Downloads (Last 12 months)175
          • Downloads (Last 6 weeks)39

          Other Metrics

          View Author Metrics

          Citations

          View Options

          Get Access

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          Get this Publication

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Media

          Figures

          Other

          Tables

          Download PDF

          View Table of Contents

          Export Citations

            Applications of LLMs in E-Commerce Search and Product Knowledge Graph: The DoorDash Case Study | Proceedings of the 17th ACM International Conference on Web Search and Data Mining (2024)

            References

            Top Articles
            Latest Posts
            Article information

            Author: Geoffrey Lueilwitz

            Last Updated:

            Views: 6600

            Rating: 5 / 5 (60 voted)

            Reviews: 83% of readers found this page helpful

            Author information

            Name: Geoffrey Lueilwitz

            Birthday: 1997-03-23

            Address: 74183 Thomas Course, Port Micheal, OK 55446-1529

            Phone: +13408645881558

            Job: Global Representative

            Hobby: Sailing, Vehicle restoration, Rowing, Ghost hunting, Scrapbooking, Rugby, Board sports

            Introduction: My name is Geoffrey Lueilwitz, I am a zealous, encouraging, sparkling, enchanting, graceful, faithful, nice person who loves writing and wants to share my knowledge and understanding with you.