2026-10-06T06:19:07Z https://api.figshare.com/v2/oai

oai:figshare.com:article/34037934 2026-10-01T03:24:57Z category_29161 item_type_7 month_year_10_2026

Large Language Models - an Overview Saleh Ramezani (17846414) Deep learning large language models deep learning artificial intelligence clinical bert gpt lstm bert llama <p dir="ltr"><b>Large Language Models: Foundations and Applications in Clinical Text</b> is an educational presentation introducing the development, architecture, and clinical applications of modern language models. The presentation traces the evolution of language modeling from early neural-network concepts and rule-based systems through n-gram models, recurrent neural networks, LSTMs, GRUs, word embeddings, transformers, and pretrained models such as BERT, GPT, and LLaMA.</p><p dir="ltr">The presentation explains how transformer architectures and self-attention overcome limitations of sequential models by allowing language models to capture relationships across longer passages of text. It also compares encoder-based and decoder-based architectures, with particular emphasis on BERT and its bidirectional representation of language, masked-language-model training, and ability to capture context in complex biomedical text.</p><p dir="ltr">A major focus is the application of language models to clinical information extraction. Using pathology reports as an example, the presentation demonstrates how Clinical BERT can represent medical concepts such as p16-positive and p16-negative findings as embeddings and use semantic similarity to classify information from new clinical text. It concludes with a practical multi-layered strategy for clinical text extraction that combines structured data, regular-expression matching, Clinical BERT, and more computationally intensive large language models for increasingly complex cases. The presentation emphasizes the tradeoffs among speed, accuracy, semantic understanding, and computational cost when designing real-world clinical natural language processing workflows.</p> 2026-10-01T03:24:57Z Text Presentation 10.6084/m9.figshare.34037934.v1 https://figshare.com/articles/presentation/Large_Language_Models_-_an_Overview/34037934 CC BY 4.0