Kategorie: NLP
Exploring BERT: Feature extraction & Fine-tuning
Natural language processing (NLP) is a set of techniques that aim to interpret and analyze human languages. By using it in more complex pipelines, we can solve predictive analytics tasks and extract valuable insights from unstructured text data.
A major breakthrough was made in the field of NLP by the introduction of transformers, which paved the way for large language models (LLMs) and generative AI research (e.g. BERT, BART, GPT).
In this article, we walk through different concepts of NLP. In the first section, we summarize the architecture of transformers and highlight its core concepts, such as the attention mechanism. Then, in the second section, we focus on BERT, one of the most popular Transformer-based LLMs, and we present examples of how it is used in data science applications.
Why creatives in advertising should embrace data science and data mining – an interview with Les Guessing
Contextualizing our world with data, part 1: Advertising. Les Guessing has a high school degree (barely) but has managed to find great success as an Emmy Winning Copywriter / Creative Director in Los Angeles (and beyond) in advertising – the marketing arm of Capitalism. Over the last 10 years, he has become hellbent on using data/Data Science/Machine Learning and aspects of Artificial Intelligence (especially NLP, Natural Language Processing) to make advertising creative more insightful, more efficient, more impactful, and funnier. He explains why creatives should work with data because. Among other reasons, the creative mindset enables them to look at data and see something from an entirely different perspective than data people.