The Archive

Large language models (LLMs) are rapidly expanding their context windows, with recent models supporting sequences of 128K tokens, 256K tokens, and beyond.... Large language models (LLMs) are rapidly expanding their context windows, with recent models supporting sequences of 128K tokens, 256K tokens, and beyond. However, training these models with extended context lengths presents significant computational and communication challenges. As context lengths grow, the memory and communication overhead of attention mechanisms scale quadratically… Source

Enterprise AI strategy template and guidance on choosing automation approaches; generic business advisory content.

OpenAI outlines Sora feed design philosophy emphasizing personalized recommendations and parental controls.

In LLM training, Expert Parallel (EP) communication for hyperscale mixture-of-experts (MoE) models is challenging. EP communication is essentially all-to-all,... In LLM training, Expert Parallel (EP) communication for hyperscale mixture-of-experts (MoE) models is challenging. EP communication is essentially all-to-all, but due to its dynamics and sparseness (only topk experts per AI token instead of all experts), it’s challenging to implement and optimize. This post details an efficient MoE EP communication solution, Hybrid-EP, and its use in the… Source

Anthropic partners with Allen Institute and Howard Hughes Medical Institute to accelerate scientific discovery.

Import AI 443 examines agent ecology systems, Moltbook framework, and adversarial agent corruption risks.

OpenAI and Snowflake announce $200M partnership embedding frontier models and agents directly in Snowflake's data platform.

SpaceX acquires xAI, consolidating AI development with rocket/hardware infrastructure.

OpenAI releases Codex app for macOS enabling parallel multi-agent coding workflows with long-running task support.

OpenAI disrupted Russia-linked influence operation using AI to generate comments on Russian cult leader arrest in Argentina.

OpenAI banned Rybar network accounts (likely Russia-origin) using AI for multilingual influence campaigns across websites and social platforms.

OpenAI banned Operation No Bell, a likely Russia-origin influence campaign using AI to produce anti-US criticism targeting African audiences.

OpenAI banned Cambodia-origin accounts using AI to conduct romance scams against Indonesian targets via translation and engagement automation.

OpenAI banned Cambodia-origin accounts using AI to impersonate recovery services and authorities, targeting fraud victims with false recovery schemes.

OpenAI banned accounts automating romance scam workflows using AI for outreach, translation, engagement, and investment fraud solicitation.

OpenAI banned likely China-origin accounts researching US persons and social-engineering tactics to enable targeted influence operations.

OpenAI banned China-linked accounts using AI for influence planning, harassment, and coordinated online operations.

NVIDIA CUDA Tile is a GPU-based programming model that targets portability for NVIDIA Tensor Cores, unlocking peak GPU performance. One of the great things... NVIDIA CUDA Tile is a GPU-based programming model that targets portability for NVIDIA Tensor Cores, unlocking peak GPU performance. One of the great things about CUDA Tile is that you can build your own DSL on top of it. This post shares the work NVIDIA is doing to integrate CUDA Tile as a backend for OpenAI Triton, an open source Python DSL designed to write DL kernels for GPUs. Source

Sparse tensors are vectors, matrices, and higher-dimensional generalizations with many zeros. They are crucial in various fields such as scientific computing,... Sparse tensors are vectors, matrices, and higher-dimensional generalizations with many zeros. They are crucial in various fields such as scientific computing, signal processing, and deep learning due to their efficiency in storage, computation, and power. Despite their benefits, handling sparse tensors manually or through existing libraries is often cumbersome, error-prone, nonportable… Source

AI coding agents enable developers to work faster by streamlining tasks and driving automated, test-driven development. However, they also introduce a... AI coding agents enable developers to work faster by streamlining tasks and driving automated, test-driven development. However, they also introduce a significant, often overlooked, attack surface by running tools from the command line with the same permissions and entitlements as the user, making them computer use agents, with all the risks those entail. The primary threat to these tools is… Source

Project Genie lets Google AI Ultra subscribers create and explore infinite interactive worlds via experimental prototype.

OpenAI describes internal data agent using GPT-5 and Codex with memory for reasoning over large datasets.

OpenAI announces retirement of GPT-4o, GPT-4.1, and o4-mini from ChatGPT effective February 13, 2026; API unaffected.

Taisei Corporation deploys ChatGPT Enterprise for internal HR and talent development workflows.

ServiceNow adopts Claude to power customer-facing apps and boost internal productivity.

NVIDIA Run:ai v2.24 introduces time-based fairshare, a new scheduling mode that brings fair-share scheduling with time awareness for over-quota resources to... NVIDIA Run:ai v2.24 introduces time-based fairshare, a new scheduling mode that brings fair-share scheduling with time awareness for over-quota resources to Kubernetes clusters. This capability, built on the open source KAI Scheduler that powers NVIDIA Run:ai, addresses a long-standing challenge in shared GPU infrastructure. Consider two teams with equal priority sharing a cluster. Source