Skip to main content
Vitaliy Chiley

Vitaliy Chiley

Vitaliy Chiley's posts

Improving Retrieval and RAG with Embedding Model Finetuning

Product

February 20, 2025/9 min read

Improving Retrieval and RAG with Embedding Model Finetuning

Llama Finetuning Blog Post Graphic

Generative AI

September 19, 2024/4 min read

Fine-tuning Llama 3.1 with Long Sequences

Mix Attention Blog Banner Image

Mosaic Research

September 18, 2024/14 min read

Inference-Friendly Models with MixAttention

Hero image with abstract drawing representing a sparse matrix on a dark background

Mosaic Research

July 1, 2024/Less than a minute

Training MoEs at Scale with PyTorch and Databricks

Abstract image of a stream of data

Mosaic Research

April 9, 2024/4 min read

Bringing MegaBlocks to Databricks

Benchmarking Large Language Models on NVIDIA H100 GPUs with CoreWeave (Part 1)

Mosaic Research

April 27, 2023/7 min read

Benchmarking Large Language Models on NVIDIA H100 GPUs with CoreWeave (Part 1)