Discuss your project

PartITech blog

Technology blog

Technical analysis, practical guides and field experience to build, modernize and maintain sustainable applications.

232 articles Page 8

LoRA or full fine-tuning: which strategy to choose for your AI models?

LoRA or Full Fine-Tuning: Which Fine-Tuning Strategy Should You Choose for Your AI Models? In a world increasingly dominated by artificial intelligence (AI), adapting language models to specific business needs has become a strategic issue for many companies. Transformer models, such as LLaMA, Mistral, Phi, Qwen, or GPT, are powerful tools capable of understanding and generating text, but they often require customization to meet particular requirements. fine-tuning is one of the most effective...

Sonata Extra Bundle: application firewall

The SonataExtraBundle provides a set of enhanced features for managing firewall rules in the Sonata Admin environment. This bundle allows administrators to create and manage rules to filter requests based on different criteria such as forbidden words, IP addresses, and user agents.

llama.cpp: run an LLM locally

Llama CPP is a new tool designed to execute language models, directly in C/C++. This tool is specially optimized for Apple Silicon processors through the use of ARM NEON technology and the Accelerate framework. It also offers AVX2 compatibility for systems based on x86 architectures. Operating mainly on the CPU, Llama CPP also integrates 4-bit quantization capabilities, thus enhancing its efficiency.