[Submitted on 15 Jun 2024]
View PDF HTML (experimental)
Abstract:Recent advances in large language models (LLMs) have unlocked novel opportunities for machine learning applications in the financial domain. These models have demonstrated remarkable capabilities in understanding context, processing vast amounts of data, and generating human-preferred contents. In this survey, we explore the application of LLMs on various financial tasks, focusing on their potential to transform traditional practices and drive innovation. We provide a discussion of the progress and advantages of LLMs in financial contexts, analyzing their advanced technologies as well as prospective capabilities in contextual understanding, transfer learning flexibility, complex emotion detection, etc. We then highlight this survey for categorizing the existing literature into key application areas, including linguistic tasks, sentiment analysis, financial time series, financial reasoning, agent-based modeling, and other applications. For each application area, we delve into specific methodologies, such as textual analysis, knowledge-based analysis, forecasting, data augmentation, planning, decision support, and simulations. Furthermore, a comprehensive collection of datasets, model assets, and useful codes associated with mainstream applications are presented as resources for the researchers and practitioners. Finally, we outline the challenges and opportunities for future research, particularly emphasizing a number of distinctive aspects in this field. We hope our work can help facilitate the adoption and further development of LLMs in the financial sector.
Submission history
From: Yaxuan Kong [view email]
[v1] Sat, 15 Jun 2024 16:11:35 UTC (9,680 KB)
FAQs
Their capability to translate content across various contexts will expand further, making them usable by business users of all levels of technical expertise. Allowing more accurate data via domain-oriented LLMs developed for specific sectors or functions is another direction for the upcoming large language models.
What is the impact of large language models? ›
Large Language Models (LLMs) have revolutionized various sectors, including education, healthcare, business, and creative industries. They enhance learning experiences, improve accessibility, and streamline assessment processes, allowing educators to focus on more nuanced teaching.
What are the use cases of LLM in banking? ›
LLMs in banking help institutions consider different scenarios and assess the associated risks. They analyze historical data and market trends to flag potential issues. One of the most valuable use cases involves creating a detailed customer profile based on a customer's transaction history and online behavior.
What is the purpose of large language models? ›
A large language model (LLM) is a deep learning algorithm that can perform a variety of natural language processing (NLP) tasks. Large language models use transformer models and are trained using massive datasets — hence, large. This enables them to recognize, translate, predict, or generate text or other content.
How fast are LLMs growing? ›
In 2019, the largest LLM had parameters of 0.09 billion. This figure increased to 17.2 billion in 2020 before exploding to 540 billion in 2022. Over a few years, a tiny figure grew exponentially, achieving a 574,368% increase.
What is the difference between generative AI and large language models? ›
LLMs can be utilized alongside generative AI models to improve content translation and localization. A large language model can decipher the nuances of language, while generative AI can create accurate translations and localized versions of the content.
Is ChatGPT a large language model? ›
OpenAI's large language models, including the models that power ChatGPT, are developed using three primary sources of information: (1) information that is publicly available on the internet, (2) information that we license from third parties, and (3) information that our users or our human trainers provide.
Why do large language models make mistakes? ›
The authors found the LLMs to be prone to similar content effects as humans. Both humans and LLMs are more likely to mistakenly label an invalid argument as valid when the semantic content is sensical and believable.
What are the use cases of large language models in banking? ›
Financial institutions can now use large language models to analyze mass data volumes, such as financial reports, and quickly generate summaries and insights that aid in risk assessment.
How to use generative AI in banking? ›
Use Cases Of Gen AI In Banking
- Use Case 1: Credit Risk Assessment. ...
- Use Case 2: Chatbots for Customer Service. ...
- Use Case 3: Fraud Detection. ...
- Use Case 4: Algorithmic Trading. ...
- Use Case 5: Gen AI Chatbots for Personalized Marketing in Banking. ...
- Use Case 6: Wealth Management and Portfolio Optimization.
The LLM was created for lawyers to expand their knowledge, study a specialized area of law, and gain international qualifications if they have earned a law degree outside the U.S. or Canada. If you're looking to advance your legal career or take the next step in your academic journey, an LLM could be for you.
Why are LLMs important? ›
The importance of LLM in Natural Language Processing (NLP)
They possess an extensive understanding of general language patterns and knowledge based on massive data sets. This enables them to achieve superior results on various tasks, such as question answering, information retrieval, sentiment analysis, and more.
What are LLM models primarily used for? ›
Large language models (LLMs) are machine learning models that can comprehend and generate human language text. They work by analyzing massive data sets of language.
What are some examples of large language models? ›
Ernie is Baidu's large language model which powers the Ernie 4.0 chatbot. The bot was released in August 2023 and has garnered more than 45 million users. Ernie is rumored to have 10 trillion parameters. The bot works best in Mandarin but is capable in other languages.
What is the potential of large language models? ›
They allow the model to relate words together through attention to multiple words in a text sequence. LLMs have been shown to be highly effective for a range of tasks in natural language processing (NLP), including classification and information extraction tasks and generative applications.
What are the future implications of LLM? ›
Key Impact
Future LLMs will understand and generate text, code, and images. Future LLMs will explain their reasoning and build trust. LLMs make programming more accessible for beginners. LLMs streamline communication and code review in group projects.
What's next for LLMs? ›
Researchers have made rapid progress extending LLM context length and augmenting their memory in other ways. They are also improving LLMs' reasoning capabilities through orchestration, or creating dynamic workflows that help the agent decompose the task into sub-tasks, and formulate, test, and execute a plan.
How will large language models change the world? ›
Education And Training: LWMs have the potential to transform the educational landscape by providing highly personalized learning experiences. These models could adapt to individual learning styles and paces, offering customized educational content that evolves based on student performance and engagement.