随着电子商务领域的巨大增长，产品建议已成为电子商务公司越来越多的兴趣领域。产品建议中最困难的任务之一是尺寸和合适的预测。电子时尚域中有很多相关的回报和退款，这给客户带来了不便，并给公司带来了损失。因此，拥有良好的尺寸和合适的推荐系统，可以预测客户的正确尺寸，不仅可以减少相关的回报和退款，还可以改善客户体验。该领域的早期作品使用传统的机器学习方法来估计购买历史记录的客户和产品尺寸。由于客户产品数据中的巨大稀疏，这些方法遭受了冷启动问题。最近，人们使用深度学习来通过嵌入客户和产品功能来解决此问题。但是，它们都没有包含在产品页面上存在的有价值的客户反馈以及客户和产品功能。我们提出了一种新颖的方法，该方法可以使用客户评论中的信息以及客户和产品功能来实现尺寸和合适的预测。与在4个数据集上使用产品和客户功能相比，我们证明了方法的有效性。我们的方法显示，在4个不同数据集的基线上，F1（宏）得分的提高了1.37％-4.31％。

Tasks critical to enterprise profitability, such as customer churn prediction, fraudulent account detection or customer lifetime value estimation, are often tackled by models trained on features engineered from customer data in tabular format. Application-specific feature engineering adds development, operationalization and maintenance costs over time. Recent advances in representation learning present an opportunity to simplify and generalize feature engineering across applications. When applying these advancements to tabular data researchers deal with data heterogeneity, variations in customer engagement history or the sheer volume of enterprise datasets. In this paper, we propose a novel approach to encode tabular data containing customer transactions, purchase history and other interactions into a generic representation of a customer's association with the business. We then evaluate these embeddings as features to train multiple models spanning a variety of applications. CASPR, Customer Activity Sequence-based Prediction and Representation, applies Transformer architecture to encode activity sequences to improve model performance and avoid bespoke feature engineering across applications. Our experiments at scale validate CASPR for both small and large enterprise applications.

每天在世界各地的在线和当地零售店成功提供数百万套餐。需要适当的套餐，以确保高客户满意度和重复购买。尽管商店的最佳努力，这些交付仍然存在各种问题。这些问题不仅由于对低周转时间的大量和高需求而导致而且由于机械运营和自然因素也是如此。这些问题范围从包装中收到错误的物品，以延迟运输到运输过程中的误操作。在提高整个过程的效率方面发挥着至关重要的作用，寻找解决方案。本文显示了如何使用来自文本评论和上传的图像使用客户反馈来查找这些问题。我们使用转移学习文本和图像模型，以最大限度地减少数千个标记示例的需求。结果表明，该模型可以找到不同的问题。此外，它还可以用于瓶颈识别，过程改进，自动退款等任务。与现有过程相比，本文提出的文本和图像模型的集合确保了几种类型的递送问题，即更适合在零售业务中提供物品的现实生活场景。此方法可以为在类似行业中提供包装的问题检测的新思路。

A large number of empirical studies on applying self-attention models in the domain of recommender systems are based on offline evaluation and metrics computed on standardized datasets, without insights on how these models perform in real life scenarios. Moreover, many of them do not consider information such as item and customer metadata, although deep-learning recommenders live up to their full potential only when numerous features of heterogeneous types are included. Also, typically recommendation models are designed to serve well only a single use case, which increases modeling complexity and maintenance costs, and may lead to inconsistent customer experience. In this work, we present a reusable Attention-based Fashion Recommendation Algorithm (AFRA), that utilizes various interaction types with different fashion entities such as items (e.g., shirt), outfits and influencers, and their heterogeneous features. Moreover, we leverage temporal and contextual information to address both short and long-term customer preferences. We show its effectiveness on outfit recommendation use cases, in particular: 1) personalized ranked feed; 2) outfit recommendations by style; 3) similar item recommendation and 4) in-session recommendations inspired by most recent customer actions. We present both offline and online experimental results demonstrating substantial improvements in customer retention and engagement.

Over the past years, fashion-related challenges have gained a lot of attention in the research community. Outfit generation and recommendation, i.e., the composition of a set of items of different types (e.g., tops, bottom, shoes, accessories) that go well together, are among the most challenging ones. That is because items have to be both compatible amongst each other and also personalized to match the taste of the customer. Recently there has been a plethora of work targeted at tackling these problems by adopting various techniques and algorithms from the machine learning literature. However, to date, there is no extensive comparison of the performance of the different algorithms for outfit generation and recommendation. In this paper, we close this gap by providing a broad evaluation and comparison of various algorithms, including both personalized and non-personalized approaches, using online, real-world user data from one of Europe's largest fashion stores. We present the adaptations we made to some of those models to make them suitable for personalized outfit generation. Moreover, we provide insights for models that have not yet been evaluated on this task, specifically, GPT, BERT and Seq-to-Seq LSTM.

随着电子商务行业的扩散，分析客户反馈是服务提供商必不可少的。最近几天，可以注意到，客户以评论分数上传购买的产品图像。在本文中，我们承担了分析此类视觉评论的任务，这是非常新的。过去，研究人员致力于分析语言反馈，但是在这里，我们没有从语言评论中获得任何可能不存在的帮助，因为可以观察到最近的趋势，客户喜欢快速上传视觉反馈而不是输入语言反馈。我们提出了一个分层体系结构，高级模型参与产品分类，而低级模型则注意从客户提供的产品图像预测评论得分。我们通过采购真实的视觉产品评论来生成数据库，这非常具有挑战性。我们的体系结构通过对所采用的数据库进行广泛的实验，从而获得了一些有希望的结果。拟议的分层体系结构比单层最佳可比架构的性能提高了57.48％。

客户的评论在在线购物中起着至关重要的作用。人们经常参考以前客户的评论或评论，以决定是否购买新产品。赶上这种行为，有些人会为骗子的客户创建不真实的评论，以了解产品的假质量。这些评论称为垃圾邮件评论，它使消费者在在线购物平台上混淆，并对在线购物行为产生负面影响。我们提出了称为Vispamreviews的数据集，该数据集具有严格的注释程序，用于检测电子商务平台上的垃圾邮件评论。我们的数据集由两个任务组成：用于检测评论是否为垃圾邮件的二进制分类任务以及用于识别垃圾邮件类型的多类分类任务。Phobert在这两个任务上均以宏平均F1分别获得了最高的结果，分别为88.93％和72.17％。

近年来，对机器学习算法在电子商务，全渠道营销和销售行业中的应用引起了人们的兴趣。它不仅符合算法的进步，而且还代表数据可用性，代表交易，用户和背景产品信息。以不同方式查找相关的产品，即替代品和补充对于供应商网站和供应商的建议至关重要，以执行有效的分类优化。本文介绍了一种新的方法，用于根据嵌入Cleora算法的图来查找产品的替代品和补充。我们还提供有关最先进的购物者算法的实验评估，研究了建议与行业专家的调查的相关性。结论是，此处提出的新方法提供了适当的推荐产品选择，需要最少的其他信息。该算法可用于各种企业，有效地识别替代品和互补产品选项。

在这项工作中，我们提出了用于商业产品分类的多模式模型，该模型结合了使用简单的融合技术从Textual（Camembert和Flaubert）和视觉数据（SE-Resnext-50）中提取的功能。所提出的方法显着优于单峰模型的性能以及在我们的特定任务上报告的类似模型的报告。我们进行了多种融合技术的实验，并发现，结合单峰网络的单个嵌入的最佳性能技术是基于结合串联和平均特征向量的方法。每种模式都补充了其他方式的缺点，表明增加模态的数量可能是改善多标签和多模式分类问题的有效方法。

推荐系统是机器学习系统的子类，它们采用复杂的信息过滤策略来减少搜索时间，并向任何特定用户建议最相关的项目。混合建议系统以不同的方式结合了多种建议策略，以从其互补的优势中受益。一些混合推荐系统已经结合了协作过滤和基于内容的方法来构建更强大的系统。在本文中，我们提出了一个混合推荐系统，该系统将基于最小二乘（ALS）的交替正方（ALS）的协作过滤与深度学习结合在一起，以增强建议性能，并克服与协作过滤方法相关的限制，尤其是关于其冷启动问题。本质上，我们使用ALS（协作过滤）的输出来影响深度神经网络（DNN）的建议，该建议结合了大数据处理框架中的特征，上下文，结构和顺序信息。我们已经进行了几项实验，以测试拟议混合体架构向潜在客户推荐智能手机的功效，并将其性能与其他开源推荐人进行比较。结果表明，所提出的系统的表现优于几个现有的混合推荐系统。

In this paper, we study item advertisements for small businesses. This application recommends prospective customers to specific items requested by businesses. From analysis, we found that the existing Recommender Systems (RS) were ineffective for small/new businesses with a few sales history. Training samples in RS can be highly biased toward popular businesses with sufficient sales and can decrease advertising performance for small businesses. We propose a meta-learning-based RS to improve advertising performance for small/new businesses and shops: Meta-Shop. Meta-Shop leverages an advanced meta-learning optimization framework and builds a model for a shop-level recommendation. It also integrates and transfers knowledge between large and small shops, consequently learning better features in small shops. We conducted experiments on a real-world E-commerce dataset and a public benchmark dataset. Meta-Shop outperformed a production baseline and the state-of-the-art RS models. Specifically, it achieved up to 16.6% relative improvement of Recall@1M and 40.4% relative improvement of nDCG@3 for user recommendations to new shops compared to the other RS models.

链接的开放数据实践导致了过去十年中网络上结构化数据的显着增长。这样的结构化数据以机器可读的方式描述了现实世界实体，并为自然语言处理领域的研究创造了前所未有的机会。但是，缺乏有关如何使用此类数据，哪种任务以及它们在多大程度上对这些任务有用的研究。这项工作着重于电子商务领域，以探索利用此类结构化数据来创建可能用于产品分类和链接的语言资源的方法。我们以RDF N四分之一的形式处理数十亿个结构化数据点，以创建数百万个与产品相关的语料库单词，后来以三种不同的方式用于创建语言资源：培训单词嵌入模型，继续预训练类似于Bert的语言模型和训练机器翻译模型，这些模型被用作生成产品相关的关键字的代理。我们对大量基准测试的评估表明，嵌入单词是提高这两个任务准确性的最可靠和一致的方法（在某些数据集中，宏观 - 平均F1中最高6.9个百分点）。但是，其他两种方法并不那么有用。我们的分析表明，这可能是由于许多原因，包括结构化数据中的偏置域表示以及缺乏词汇覆盖范围。我们分享我们的数据集，并讨论如何将我们所学到的经验教训朝着这一方向介绍未来的研究。

最近，电子商务平台上的产品问题应答（PQA）引起了越来越幅度的关注，因为它可以作为智能的在线购物助理和改善客户购物体验。它的关键功能，自动回答的产品相关问题的生成，通过旨在在与问题相关的答案时产生内容保存。然而，现有方法忽略了PQA，即个性化的重要特征。提供相同的“完全总结”回答所有客户的回答不足，因为许多客户更愿意通过考虑自己的偏好对产品方面或信息需求的偏好来看待具有定制信息的个性化答案。为了解决这一挑战，我们提出了一种新颖的个性化答复生成方法（页面），具有多视角偏好建模，探讨了历史用户生成的内容，以模拟用户偏好，以在PQA中生成个性化答案。具体而言，我们首先将问题相关的用户历史作为外部知识作为模拟知识级用户偏好。然后我们利用高斯SoftMax分布模型来捕获潜在的方面级别用户偏好。最后，我们通过利用个人用户偏好和动态用户词汇表，开发一个角色感知指针网络以在内容和样式方面生成个性化答案。实验结果对现实世界电子商务QA数据集表明，所提出的方法通过生成信息和定制答案来表明现有方法，并显示电子商务中的答案可以从个性化中受益。

Artificial intelligence and natural language processing (NLP) are increasingly being used in customer service to interact with users and answer their questions. The goal of this systematic review is to examine existing research on the use of NLP technology in customer service, including the research domain, applications, datasets used, and evaluation methods. The review also looks at the future direction of the field and any significant limitations. The review covers the time period from 2015 to 2022 and includes papers from five major scientific databases. Chatbots and question-answering systems were found to be used in 10 main fields, with the most common use in general, social networking, and e-commerce areas. Twitter was the second most commonly used dataset, with most research also using their own original datasets. Accuracy, precision, recall, and F1 were the most common evaluation methods. Future work aims to improve the performance and understanding of user behavior and emotions, and address limitations such as the volume, diversity, and quality of datasets. This review includes research on different spoken languages and models and techniques.

我们的目标是为阿里巴巴业务的每个用户和每个产品项目建立一般代表性（嵌入），包括淘宝和Tmall，这是世界上最大的电子商务网站之一。用户和项目的代表性在各种下游应用程序中发挥着关键作用，包括建议系统，搜索，营销，需求预测等。受到自然语言处理（NLP）域中的BERT模型的启发，我们提出了GUIM（与代表的混合物混合在一起）的GUIM（一般用户项目），以实现大量，结构化的多模式数据，包括数亿美元的相互作用用户和项目。我们利用表示（MOR）的混合物作为一种新颖的表示形式来建模每个用户的各种兴趣。此外，我们使用对比度学习中的Infonce，以避免由于众多词汇的大小（令牌）词汇大小，因此避免了棘手的计算成本。最后，我们建议一组代表性的下游任务作为标准基准，以评估学到的用户和/或项目嵌入的质量，类似于NLP域中的胶合基准。我们在这些下游任务中的实验结果清楚地表明了从GUIM模型中学到的嵌入的比较价值。

Customers are rapidly turning to social media for customer support. While brand agents on these platforms are motivated and well-intentioned to help and engage with customers, their efforts are often ignored if their initial response to the customer does not match a specific tone, style, or topic the customer is aiming to receive. The length of a conversation can reflect the effort and quality of the initial response made by a brand toward collaborating and helping consumers, even when the overall sentiment of the conversation might not be very positive. Thus, through this study, we aim to bridge this critical gap in the existing literature by analyzing language's content and stylistic aspects such as expressed empathy, psycho-linguistic features, dialogue tags, and metrics for quantifying personalization of the utterances that can influence the engagement of an interaction. This paper demonstrates that we can predict engagement using initial customer and brand posts.

在线评论对客户的购买决策有了重大影响，以满足任何产品或服务。但是，假审查可以误导消费者和公司。已经开发了几种模型来使用机器学习方法检测假审查。许多这些模型具有一些限制，导致在虚假和真正的评论之间具有低准确性。这些模型仅集中在语言特征上，以检测虚假评论，未能捕获评论的语义含义。要解决此问题，本文提出了一种新的集合模型，采用变换器架构，以在一系列虚假评论中发现隐藏的模式并准确地检测它们。该拟议方法结合了三种变压器模型来提高虚假和真正行为分析和建模的鲁棒性，以检测虚假评论。使用半真实基准数据集的实验结果显示了拟议的型号模型的优越性。

最近的趋势表明，一般的模型，例如BERT，GPT-3，剪辑，在规模上广泛的数据训练，已经显示出具有单一学习架构的各种功能。在这项工作中，我们通过在大尺度上培训通用用户编码器来探讨通用用户表示学习的可能性。我们展示了扩展法在用户建模区域中持有，其中训练错误将作为幂律规模的幂级，具有计算量。我们的对比学习用户编码器（CLUE），优​​化任务 - 不可知目标，并且所产生的用户嵌入式延伸我们对各种下游任务中的可能做些什么。 Clue还向其他域和系统展示了巨大的可转移性，因为在线实验上的性能显示在线点击率（CTR）的显着改进。此外，我们还调查了如何根据扩展因子，即模型容量，序列长度和批量尺寸来改变性能如何变化。最后，我们讨论了线索的更广泛影响。

了解产品内容的视觉和语言表示对于电子商务中的搜索和推荐应用程序至关重要。作为在线购物平台的骨干，受到代表学习研究的最新成功的启发，我们提出了一个对比度学习框架，该框架使用未标记的原始产品文本和图像来对齐语言和视觉模型。我们介绍了我们用来培训大规模代表性学习模型的技术，并共享解决特定领域挑战的解决方案。我们使用预先训练的模型作为多种下游任务的骨干进行研究，包括类别分类，属性提取，产品匹配，产品聚类和成人产品识别。实验结果表明，我们所提出的方法在每个下游任务中均优于单个模态和多种方式的基线。

The fashion industry is one of the most active and competitive markets in the world, manufacturing millions of products and reaching large audiences every year. A plethora of business processes are involved in this large-scale industry, but due to the generally short life-cycle of clothing items, supply-chain management and retailing strategies are crucial for good market performance. Correctly understanding the wants and needs of clients, managing logistic issues and marketing the correct products are high-level problems with a lot of uncertainty associated to them given the number of influencing factors, but most importantly due to the unpredictability often associated with the future. It is therefore straightforward that forecasting methods, which generate predictions of the future, are indispensable in order to ameliorate all the various business processes that deal with the true purpose and meaning of fashion: having a lot of people wear a particular product or style, rendering these items, people and consequently brands fashionable. In this paper, we provide an overview of three concrete forecasting tasks that any fashion company can apply in order to improve their industrial and market impact. We underline advances and issues in all three tasks and argue about their importance and the impact they can have at an industrial level. Finally, we highlight issues and directions of future work, reflecting on how learning-based forecasting methods can further aid the fashion industry.