# Beyond the KV cache: Training and serving i14’s Laplace 3B linear attention model on AWS Trainium2 with native PyTorch

Category: agent-infrastructure
Published: 2026-10-20T21:14:10.000Z
Source: [AWS Machine Learning blog](https://aws.amazon.com/blogs/machine-learning/beyond-the-kv-cache-training-and-serving-i14s-laplace-3b-linear-attention-model-on-aws-trainium2-with-native-pytorch/)
Agent usefulness: 55/100
Confidence: 0.9
Content mode: source-watch
Verified: 2026-10-21T00:17:54.373Z
Tags: aws, bedrock, machine-learning

## Human Summary
AWS Machine Learning blog showcases i14's training and serving of Laplace 3B, a linear attention model on AWS Trainium2 that maintains a constant recurrent state of 29.5 MB per sequence.

## Agent Summary
i14 demonstrated training and serving Laplace 3B, a linear attention model on AWS Trainium2 via native PyTorch, eliminating KV-cache growth by keeping recurrent state fixed at 29.5 MB per sequence.

## Body
The AWS Machine Learning blog detailed the training and deployment of i14’s Laplace 3B linear attention model on AWS Trainium2 hardware using native PyTorch. In contrast to conventional transformer architectures that face memory scaling challenges due to expanding KV caches during long context generation, Laplace 3B maintains a constant recurrent state size of 29.5 MB per sequence regardless of context length, stabilizing serving memory requirements.

## Recommended actions
- Review i14 Laplace 3B linear attention architecture for use cases requiring fixed-memory long-context inference.
- Evaluate AWS Trainium2 native PyTorch capabilities for training and serving alternative attention models.

## Sponsors
No sponsor placement attached.

## Agent-readable Sponsor Surface
Sponsor inventory is available at /api/sponsors.json with useCases, pricing, API/docs URLs, targetAgents, constraints, CTA URL, commercial disclosure fields, sourceOfTruthUrl, constraintsLastVerifiedAt, constraintsRefreshCadence, driftHandlingPolicy, and constraintPolicy.