Posts by Tags

3D

WM3D: Native-3D World Modeling for Robot Action

2 minute read

Published:

WM3D argues that robot world models should predict explicit 3D state — depth, point geometry, pose, robot state, task text, and action-conditioned dynamics — then render video as a view of that imagined world.

attention

GMSWA: Constant-Cache Long-Context Memory

2 minute read

Published:

GMSWA fuses exact sliding-window attention with a recurrent matrix memory. In a controlled 340M study, it preserves softmax-like base quality, recovers real semantic recall, and keeps a constant cache, while exposing a sharp synthetic-recall limitation.

category1

Future Blog Post

less than 1 minute read

Published:

This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.

Blog Post number 4

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 3

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 2

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 1

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

category2

Future Blog Post

less than 1 minute read

Published:

This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.

Blog Post number 4

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 3

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 2

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 1

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

cool posts

Future Blog Post

less than 1 minute read

Published:

This post will show up by default. To disable scheduling of future posts, edit config.yml and set future: false.

Blog Post number 4

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 3

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 2

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

Blog Post number 1

less than 1 minute read

Published:

This is a sample blog post. Lorem ipsum I can’t remember the rest of lorem ipsum and don’t have an internet connection right now. Testing testing testing this blog post. Blog posts are cool.

embodied AI

WM3D: Native-3D World Modeling for Robot Action

2 minute read

Published:

WM3D argues that robot world models should predict explicit 3D state — depth, point geometry, pose, robot state, task text, and action-conditioned dynamics — then render video as a view of that imagined world.

language modeling

GMSWA: Constant-Cache Long-Context Memory

2 minute read

Published:

GMSWA fuses exact sliding-window attention with a recurrent matrix memory. In a controlled 340M study, it preserves softmax-like base quality, recovers real semantic recall, and keeps a constant cache, while exposing a sharp synthetic-recall limitation.

long context

GMSWA: Constant-Cache Long-Context Memory

2 minute read

Published:

GMSWA fuses exact sliding-window attention with a recurrent matrix memory. In a controlled 340M study, it preserves softmax-like base quality, recovers real semantic recall, and keeps a constant cache, while exposing a sharp synthetic-recall limitation.

recurrent memory

GMSWA: Constant-Cache Long-Context Memory

2 minute read

Published:

GMSWA fuses exact sliding-window attention with a recurrent matrix memory. In a controlled 340M study, it preserves softmax-like base quality, recovers real semantic recall, and keeps a constant cache, while exposing a sharp synthetic-recall limitation.

robot manipulation

WM3D: Native-3D World Modeling for Robot Action

2 minute read

Published:

WM3D argues that robot world models should predict explicit 3D state — depth, point geometry, pose, robot state, task text, and action-conditioned dynamics — then render video as a view of that imagined world.

world model

WM3D: Native-3D World Modeling for Robot Action

2 minute read

Published:

WM3D argues that robot world models should predict explicit 3D state — depth, point geometry, pose, robot state, task text, and action-conditioned dynamics — then render video as a view of that imagined world.