深度神经网络在预测质量方面表现出巨大的成功，而可靠且稳健的不确定性估计仍然是一个挑战。预测性不确定性补充模型预测，并实现了下游任务的改进功能，包括嵌入式和移动应用，例如虚拟现实，增强现实，传感器融合和感知。这些应用程序通常需要复杂性的妥协，以获得由于内存非常有限和计算资源而导致的不确定性估计。我们通过使用Axolotl框架构建Monte Carlo辍学（MCDO）模型来解决这个问题;具体而言，我们多样化采样的子网，利用辍学模式，并使用分支技术来提高预测性能，同时保持快速计算。我们在使用CIFAR10 DataSet上进行（1）多级分类任务的实验，（2）更复杂的人体分段任务。我们的结果表明我们的方法通过接近深度集成预测质量和不确定性估算来达到效果，同时仍在实现资源限制的移动平台的推断。

The number of international benchmarking competitions is steadily increasing in various fields of machine learning (ML) research and practice. So far, however, little is known about the common practice as well as bottlenecks faced by the community in tackling the research questions posed. To shed light on the status quo of algorithm development in the specific field of biomedical imaging analysis, we designed an international survey that was issued to all participants of challenges conducted in conjunction with the IEEE ISBI 2021 and MICCAI 2021 conferences (80 competitions in total). The survey covered participants' expertise and working environments, their chosen strategies, as well as algorithm characteristics. A median of 72% challenge participants took part in the survey. According to our results, knowledge exchange was the primary incentive (70%) for participation, while the reception of prize money played only a minor role (16%). While a median of 80 working hours was spent on method development, a large portion of participants stated that they did not have enough time for method development (32%). 25% perceived the infrastructure to be a bottleneck. Overall, 94% of all solutions were deep learning-based. Of these, 84% were based on standard architectures. 43% of the respondents reported that the data samples (e.g., images) were too large to be processed at once. This was most commonly addressed by patch-based training (69%), downsampling (37%), and solving 3D analysis tasks as a series of 2D tasks. K-fold cross-validation on the training set was performed by only 37% of the participants and only 50% of the participants performed ensembling based on multiple identical models (61%) or heterogeneous models (39%). 48% of the respondents applied postprocessing steps.

Fusion-in-Decoder (FiD) is a powerful retrieval-augmented language model that sets the state-of-the-art on many knowledge-intensive NLP tasks. However, FiD suffers from very expensive inference. We show that the majority of inference time results from memory bandwidth constraints in the decoder, and propose two simple changes to the FiD architecture to speed up inference by 7x. The faster decoder inference then allows for a much larger decoder. We denote FiD with the above modifications as FiDO, and show that it strongly improves performance over existing FiD models for a wide range of inference budgets. For example, FiDO-Large-XXL performs faster inference than FiD-Base and achieves better performance than FiD-Large.

癌症护理中的治疗决策受到随机对照试验（RCT）的治疗效应估计的指导。 RCT估计在某个人群中，一种治疗与另一种治疗的平均效应。但是，治疗可能对人群中的每个患者都不同样有效。了解针对特定患者和肿瘤特征量身定制的治疗的有效性将实现个性化的治疗决策。通过平均RCT中不同患者亚组的结果来获得量身定制的治疗效果，需要大量的患者在所有相关亚组中具有足够的统计能力，以实现所有可能的治疗。美国癌症联合委员会（AJCC）建议研究人员开发结果预测模型（OPMS），以实现个性化治疗决策。 OPM有时称为风险模型或预后模型，使用患者和肿瘤特征来预测患者的结局，例如总体生存。假设这些预测对于使用“只有在OPM预测患者具有高复发风险的情况下开出化学疗法的规则”之类的规则，对治疗决策有用。 AJCC认识到可靠预测的重要性，发布了OPM的清单，以确保设计OPM设计的患者群体的可靠OPM预测准确性。但是，准确的结果预测并不意味着这些预测会产生良好的治疗决策。从这个角度来看，我们表明OPM依靠固定的治疗政策，这意味着被发现可以准确预测验证研究结果的OPM在用于治疗决策的情况下仍会导致患者伤害。然后，我们提供有关如何开发对个性化治疗决策有用的模型以及如何评估模型是否具有决策价值的指导。

在该职位论文中，我们提出了一种新方法，以基于问题的产生和实体链接来生成文本的知识库（KB）。我们认为，所提出的KB类型具有传统符号KB的许多关键优势：尤其是由小型模块化组件组成，可以在组合上合并以回答复杂的查询，包括涉及“多跳跃”的关系查询和查询。“推论。但是，与传统的KB不同，该信息商店与常见的用户信息需求相符。

心电图（ECG）是一种有效且无侵入性诊断工具，可测量心脏的电活动。解释ECG信号检测各种异常是一个具有挑战性的任务，需要专业知识。最近，利用深度神经网络的ECG分类来帮助医疗从业者变得流行，但他们的黑匣子自然妨碍了临床实施。已经提出了几种基于显着性的可解释性技术，但它们仅表明重要特征的位置而不是实际功能。我们提出了一种名为QLST的新型解释性技术，一种基于查询的潜空间遍历技术，可以提供对任何ECG分类模型的解释。使用QLST，我们训练一个神经网络，该网络网络学习在大学医院数据集训练的变分性AutoEncoder的潜在空间中，超过80万家ECG为28个疾病。我们通过实验证明我们可以通过通过这些遍历来解释不同的黑匣子分类器。

尽管近期因因果推断领域的进展，迄今为止没有关于从观察数据的收集治疗效应估算的方法。对临床实践的结果是，当缺乏随机试验的结果时，没有指导在真实情景中似乎有效的指导。本文提出了一种务实的方法，以获得从观察性研究的治疗效果的初步但稳健地估算，为前线临床医生提供对其治疗策略的信心程度。我们的研究设计适用于一个公开问题，估算Covid-19密集护理患者的拳击机动的治疗效果。

从对量子网络和传感器的基本力量的超敏感探测器，机械谐振器能够在室温环境中实现下一代技术。目前，氮化硅纳米腔作为这些进步中的领先微芯片平台，允许机械谐振器从环境热噪声显着隔离的机械谐振器。然而，迄今为止，人类直觉仍然是设计过程背后的驱动力。这里，由自然启发和通过机器学习引导，开发了一种蜘蛛网纳米机械谐振器，其显示通过数据驱动优化算法发现的新颖“扭转软夹紧”机构从环境热环境中分离的振动模式。然后制造该生物启发的谐振器;通过在室温环境中通过高于10亿以上的机械师进行实验证实了新的范式。与其他最先进的谐振器相比，这种里程碑是通过紧凑的设计实现的，该设计不需要亚微米光刻特征或复声胶凝带，使得在大尺度上制造显着更容易和更便宜。在这里，我们展示了机器学习与人类直觉一起工作的能力，以增加创造性的可能性，并在计算和纳米技术中发现新的策略。

最近的证据指出了高性能跨度预测模型的脆弱的动机，我们将注意力指向多种选择阅读理解。特别是，这项工作介绍了一种新的方法，用于通过重量全球正常化改进答案选择，通过对文档的一部分的预测的加权全球化。我们表明，将我们的方法应用于适用于答案选择的跨度预测模型，有助于从叙述问题的长摘要进行模型性能，这是一个充满挑战的阅读理解数据集，具有答案选择任务，我们强烈提高任务基线性能+36.2平均互酷等级。

Advances in computer vision and machine learning techniques have led to significant development in 2D and 3D human pose estimation from RGB cameras, LiDAR, and radars. However, human pose estimation from images is adversely affected by occlusion and lighting, which are common in many scenarios of interest. Radar and LiDAR technologies, on the other hand, need specialized hardware that is expensive and power-intensive. Furthermore, placing these sensors in non-public areas raises significant privacy concerns. To address these limitations, recent research has explored the use of WiFi antennas (1D sensors) for body segmentation and key-point body detection. This paper further expands on the use of the WiFi signal in combination with deep learning architectures, commonly used in computer vision, to estimate dense human pose correspondence. We developed a deep neural network that maps the phase and amplitude of WiFi signals to UV coordinates within 24 human regions. The results of the study reveal that our model can estimate the dense pose of multiple subjects, with comparable performance to image-based approaches, by utilizing WiFi signals as the only input. This paves the way for low-cost, broadly accessible, and privacy-preserving algorithms for human sensing.