AIFuture
Back to news
AI ResearchMarkTechPost·

Perplexity Open Sources Lily: A Rust + Metal Inference Engine for Qwen3.6-35B-A3B on Apple Silicon

Perplexity has open sourced Lily, the local inference engine behind Hybrid Compute in Perplexity Computer. Built in Rust with custom Metal kernels for one model on one chip family, it averages 1.23x MLX-LM's prefill throughput and 1.35x its decode throughput on a 40-core, 128 GB M5 Max. The post Perplexity Open Sources Lily: A Rust + Metal Inference Engine for Qwen3.6-35B-A3B on Apple Silicon…

This is a summary curated by AIFuture. Read the complete article at the original source:

Read the full story on MarkTechPost

Build the skills behind the headlines

Data ScienceedX

CS50's Introduction to AI with Python

Harvard's deep dive into the algorithms behind modern AI — search, knowledge, optimization, and machine learning.

Intermediate·Free / Verified
View Course
Data ScienceCoursera

Machine Learning Specialization

Andrew Ng's flagship program covering supervised and unsupervised learning, neural networks, and best practices for real-world ML.

Beginner·Subscription
View Course
Data ScienceCoursera

Deep Learning Specialization

Five-course series on neural networks, CNNs, sequence models, and transformers from DeepLearning.AI.

Intermediate·Subscription
View Course

Never miss what matters in AI

Get the most important AI news and course picks in your inbox.