Processing 是一门开源编程语言和与之配套的集成开发环境（IDE）的名称。Processing 在电子艺术和视觉设计社区被用来教授编程基础，并运用于大量的新媒体和互动艺术作品中。
VIP内容
论文题目： Learning Conceptual-Contextual Embeddings for Medical Text
论文摘要：
对于自然语言理解任务来说，外部知识通常是有用的。本文介绍了一个上下文文本表示模型，称为概念上下文(CC)嵌入，它将结构化的知识合并到文本表示中。与实体嵌入方法不同，文中提到的方法将知识图编码到上下文模型中。就像预先训练好的语言模型一样，CC嵌入可以很容易地在广泛的任务中重用。模型利用语义泛化，有效地编码了庞大的UMLS数据库。电子实验健康记录(EHRs)和医疗文本处理基准表明，而使得模型大大提高了监督医疗NLP任务的性能。
成为VIP会员查看完整内容
热门内容
Recently, the emergence of pre-trained models (PTMs) has brought natural language processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP. We first briefly introduce language representation learning and its research progress. Then we systematically categorize existing PTMs based on a taxonomy with four perspectives. Next, we describe how to adapt the knowledge of PTMs to the downstream tasks. Finally, we outline some potential directions of PTMs for future research. This survey is purposed to be a hands-on guide for understanding, using, and developing PTMs for various NLP tasks.
最新内容
最新论文
Learning in Gaussian Process models occurs through the adaptation of hyperparameters of the mean and the covariance function. The classical approach entails maximizing the marginal likelihood yielding fixed point estimates (an approach called \textit{Type II maximum likelihood} or ML-II). An alternative learning procedure is to infer the posterior over hyperparameters in a hierarchical specification of GPs we call \textit{Fully Bayesian Gaussian Process Regression} (GPR). This work considers two approximation schemes for the intractable hyperparameter posterior: 1) Hamiltonian Monte Carlo (HMC) yielding a sampling-based approximation and 2) Variational Inference (VI) where the posterior over hyperparameters is approximated by a factorized Gaussian (mean-field) or a full-rank Gaussian accounting for correlations between hyperparameters. We analyze the predictive performance for fully Bayesian GPR on a range of benchmark data sets.
