Eric Buehler

mistral.rs

• mistral.rs
  • Blazingly fast LLM inference.
• UQFF maker
  • Automated generation of UQFF models with mistral.rs.

Libraries

• Trc
  • A faster Arc: a Rust thread reference counted smart pointer.
• FlexRc
  • Fast, flexible, and safe reference counted type.

Programming Languages

• Kestrel
  • Simple and safe - a statically and strongly typed programming language that compiles to LLVM.
• Falcon Programming Language
  • An interpreted programming language built using C++ that is very similar to Python.
• Merlin
  • A dynamically and strongly typed programming language built in Rust that does not have a GIL and unleashes the power of multithreading.

Machine Learning Libraries

• candle-vllm
  • Efficent platform for inference and serving local Candle LLMs including an OpenAI compatible API server.
• candle-lora
  • LoRA implemented for the Candle machine learning framework.
• candle-sampling
  • Sampling techniques for Candle.
• candle_graphs
  • Easy-to-use CUDA graph API for Candle.
• X-LoRA
  • X-LoRA: Mixture of LoRA Experts.
• diffusion-rs
  • Blazingly fast inference of diffusion models.

Machine Learning Applications

• PerceiverIO Classifier
  • An MNIST classifier built using PerceiverIO.
• The Neuron
  • A fully autonomous robot, with a detailed build guide.
• CodingGPT
  • A GPT-like autoregressive, decoder-only transformer trained on data scraped from Reddit programming and science subreddits.

Mathematics

• Automatic Differentiation
  • My personal implementation of automatic differentiation, a method that powers ML and is used to calculate derivatives.
• Proofling
  • An automatic proof checker. Just plug in truth statements, and it will check for inconsistencies