Wrong position embedding size?

by lanking - opened Jul 16, 2024

Should that be 131072 as of 128k?

•

4k is 4096, 8k is 8192. Do powers of two and you get 131072 for 128k.

lanking changed discussion status to closed Aug 12, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment