0:0030:40

NLP in Fintech: How Large Language Models are transforming the future of Fintech

Jayeeta Putatunda 30:40 2023

Fintech can skip building NLP from scratch, but not the human in the loop

Language models have grown from millions of parameters to almost trillions in a couple of years, and some open-source versions can now be retrained for commercial use. For a regulated industry like finance, that opens a faster route to question answering and summarization without reinventing the wheel. Jayeeta Putatunda, Senior Data Scientist at Fitch Ratings, shows where that shortcut works and asks what it takes to use it safely.

See how to fine-tune open-source models and build a DistilBERT question-answering pipeline

Watch on YouTube

In short

Jayeeta Putatunda, Senior Data Scientist at Fitch Ratings, explains how open-source large language models and transfer learning let regulated fintech teams build NLP products without starting from scratch. She maps fintech use cases, explains when to freeze or fine-tune model layers, and demonstrates a DistilBERT question-answering pipeline with Hugging Face, closing with a warning against over-promising automation.

“And we are not talking about like models with like a million parameters, we are like almost in trillions now.”
“It's definitely a crucial thing because changing in the semantics of the prompt, like nuances of how you frame the question can, can affect the outcome of the answers.”

What you will learn

  • Identify where NLP adds value in fintech, from chatbots and churn analysis to credit rating, fraud detection and report generation.
  • Decide when to use a pre-trained model off the shelf and when to freeze early layers and fine-tune later ones on domain data.
  • Build a basic extractive question-answering pipeline with Hugging Face Transformers and DistilBERT.
  • Combine an extractive model with an instruction-tuned model such as Flan-T5 to add reasoning and validate answers.
  • Set realistic expectations for LLM projects by evaluating data and models and keeping a human in the loop.

Key takeaways from the speaker

  • NLP in Finance use-cases
  • Implementation of a Question Answering system using open-source Large Language Models
  • Pitfalls to avoid while building an end-to-end NLP pipeline

Details

Level
Intermediate
Format
Tech talk
Technical depth
Practitioner
For
Early career, Mid-career, Senior individual contributor
Length
30:40
Published
June 2023

Questions this talk answers

When should a team use transfer learning instead of training a model from scratch?

When labeled data is scarce or expensive to create with subject matter experts, and a pre-trained model exists on a large data set with properties similar to the target task.

What is the difference between off-the-shelf use and off-the-shelf plus augmentation?

Off the shelf, you freeze the early layers and replace only the last layer for your task; with augmentation, you also selectively retrain later layers on nuanced data such as legal or patent documents.

Where is NLP being used in fintech today?

In customer service chatbots and virtual assistants, CRM optimization and churn analysis, credit rating from qualitative text, governance, fraud detection and generating executive summaries and reports.

When is DistilBERT the right choice and when is Flan-T5 better?

DistilBERT is extractive and pinpoints the exact span that answers a question, while instruction-tuned Flan-T5 can add a reasoning or one-line explanation, so the two can be chained to validate answers.

How should organizations set expectations for LLM projects?

They should not promise that manual workflows will be fully automated at human level; instead they should evaluate data and models, keep a human in the loop at all stages and test several model flavors with SMEs.

About this talk

1\ Overview of AI in Finance - where it is and the path forward 2\ Best practices to consider as organizations begin implementing end-to-end ML models 3\ A case study on how to use open-source NLP large language models (LLMs) to build a domain-specific Question-Answering model

Topics

Related talks

Browse the library