Listing Links

fly.io x

Tags

see all

Using LLama.cpp with Elixir and Rustler (fly.io)

The article discusses the implementation and utilization of LLama.CPP with Elixir through Rustler, exploring the process of creating a library to interface with LLama.CPP, handling memory safely, and using the model for text prediction. It emphasises the importance of memory management and the advantages of leveraging BEAM’s garbage collection for long-living Rust structures.
Main Points
- IntroductionIntroduction to using LLama.CPP with Elixir and Rustler, presenting the concept and the initial steps towards integration.
- Developing the LibraryDetailed walkthrough of creating a new Elixir library to interface with rust-llama-cpp, including setting up dependencies and scaffolding.
- Memory ManagementExplanation of managing memory in the Rust-Erlang bridge using Rustler's ResourceArc for safe memory handling.
- Model UsageIllustration of the process to invoke and use the LLama.CPP model within Elixir through Rustler for text prediction.
- ConclusionConclusion noting the potential of rust-llama-cpp integration in Elixir projects and encouraging contributions.
12

200

47

63
Abusing LiveView's new Async Assigns Feature (fly.io)

The article explores the new async assigns feature in Phoenix LiveView by comparing it to previous methods of linking processes for asynchronous operations. It details the advantages of async assigns for enhancing user experience, offering insights into how these can be utilized for a variety of use cases, including those that deviate from fetching a final result, such as continuous data streams or focusing on side-effects.
Main Points
- Asynchronous Processes Enhance UILiveView now allows launching asynchronous processes that do not block the user interface, enhancing real-time interactivity.
- Versatility of Async AssignsAsync assigns in LiveView are versatile enough to handle loading states, errors, task cancellations, and more, streamlining the development of reactive applications.
12

200

47

63