Explainability is a topic of growing importance in NLP. In this work, we provide a unified perspective of explainability as a communication problem between an explainer and a layperson about a classifier’s decision. We use this framework to compare several … Read More
Author Archives: admin
Can 5G and Machine Learning Replace the GPS?
Whereas physical obstacles were mostly associated with signal attenuation in telecommunications, their presence in 5G’s millimeter wave systems adds complex, non-linear phenomena, including reflections and scattering. The result is a multipath propagation environment, shaped by the obstacles encountered during transmission, … Read More
Exploring Label Structure and Spatial Attention for Fashion Images Classification
In order to make decisions, for instance when purchasing a product, people rely on rich and accurate descriptions, which entail multi-label retrieval processes. However, multi-label classification is challenged by high dimensional and complex feature spaces and its dependency on large … Read More
Adaptively Sparse Transformers
Attention mechanisms have become ubiquitous in NLP. Recent architectures, notably the Transformer, learn powerful context-aware word representations through layered, multi-headed attention. The multiple heads learn diverse types of word relationships. However, with standard softmax attention, all attention heads are dense, … Read More
Evaluating Neural Methods for Approximate String Matching and Duplicate Detection
Duplicate detection concerns with identifying pairs of attributes/records that refer to the same real-world object, thus corresponding to a fundamental process when ensuring data quality in databases. Existing methods to detect duplicate attributes can leverage heuristic string similarity measures based … Read More
A Biologically Plausible Learning Algorithm for Artificial Neural Networks
Artificial neural networks, one of the most successful approaches to supervised learning, were originally inspired by their biological counterparts. However, the most successful learning algorithm for artificial neural networks, backpropagation, is considered biologically implausible. Many believe that the next generation … Read More
Variational Mixture of Normalizing Flows
In the past few years, deep generative models, such as generative adversarial networks, variational autoencoders, and their variants, have seen wide adoption for the task of modelling complex data distributions. In spite of the outstanding sample quality achieved by those … Read More
Sparse and Structured Visual Attention
Visual attention mechanisms are widely used in multimodal tasks, such as image captioning and visual question answering (VQA), being softmax attention mechanism the standard choice. One drawback of softmax-based attention mechanisms is that they assign probability mass to all image … Read More
INSIGHT: Advancing NLP for scaling-up Media Monitoring and Technology Watch
We’ll discuss how Priberam is applying machine learning to the problems of Media Monitoring and Technology Watch in the context of the INSIGHT P2020 project. We’ll show a working prototype and describe the developed microservices platform, and how the several … Read More
Learning of leader-follower graph from time-correlated big data streams with missing entries
Nowadays we are collecting high-dimensional and large data streams, where many dimensions can be expressing basically the same information on the underlying process of interest. This redundancy is apparent, for example, if we observe mass media news outputs through time. … Read More