AIFuture
Back to news
AI ResearchMarkTechPost·

Perplexity Open Sources Lily: A Rust + Metal Inference Engine for Qwen3.6-35B-A3B on Apple Silicon

Perplexity has open sourced Lily, the local inference engine behind Hybrid Compute in Perplexity Computer. Built in Rust with custom Metal kernels for one model on one chip family, it averages 1.23x MLX-LM's prefill throughput and 1.35x its decode throughput on a 40-core, 128 GB M5 Max. The post Perplexity Open Sources Lily: A Rust + Metal Inference Engine for Qwen3.6-35B-A3B on Apple Silicon…

This is a summary curated by AIFuture. Read the complete article at the original source:

Read the full story on MarkTechPost

More AI News

ProductMarkTechPost

Contrastive-LM Releases CLM-8B: An Open System One Model That Scores Agent Actions Up to 9× Faster Than Jev

Contrastive-LM has released CLM-8B, an open System One model that scores candidate actions against a state instead of generating text. It adds 2 small projection heads to a frozen Qwen3-8B encoder and trains them with a contrastive InfoNCE objective. In zero-shot tests it runs up to 9× faster than TypeSafe's Jev. With fine-tuned heads as a verifier, it reaches 81.6% on held-out DeepSWE tasks and…

Sep 24, 2026

IndustryTechCrunch

Everything new coming to Meta’s AI agent Muse

CEO Mark Zuckerberg kicked off the company’s annual Connect event in Menlo Park on Wednesday with a keynote that made one thing clear: Meta is going all-in on Muse. It's even coming to Meta's AI glasses.

Sep 24, 2026

AI ResearchMarkTechPost

A Coding Guide to TypeSafe AI Jev: Typed Decisions, Calibrated Confidence, and Speculative Fan-Out with a System One Model

This tutorial provides a complete coding guide to TypeSafe AI's Jev, a System One model designed for non-text, structured judgments. It covers installing the official Python SDK, using primitive question types (Choice, Score, Noul), implementing speculative fan-out, confidence-gated routing, and building async production workflows The post A Coding Guide to TypeSafe AI Jev: Typed Decisions,…

Sep 24, 2026

Build the skills behind the headlines

Data ScienceedX

CS50's Introduction to AI with Python

Harvard's deep dive into the algorithms behind modern AI — search, knowledge, optimization, and machine learning.

Intermediate·Free / Verified
View Course
Generative AICoursera

Generative AI for Everyone

Andrew Ng explains how generative AI works and how to apply it in your work and life — no coding required.

Beginner·Subscription
View Course
Data ScienceCoursera

Deep Learning Specialization

Five-course series on neural networks, CNNs, sequence models, and transformers from DeepLearning.AI.

Intermediate·Subscription
View Course

Never miss what matters in AI

Get the most important AI news and course picks in your inbox.