this post was submitted on 16 Mar 2025
23 points (96.0% liked)

Programmer Humor

22188 readers
1510 users here now

Welcome to Programmer Humor!

This is a place where you can post jokes, memes, humor, etc. related to programming!

For sharing awful code theres also Programming Horror.

Rules

founded 2 years ago
MODERATORS
anzo@programming.dev
Feyter@programming.dev
BurningTurtle@programming.dev
pylapp@programming.dev
23
muskrat's data eng expert's hard drive overheats while processing 60k rows (lemmy.dbzer0.com)
submitted 2 weeks ago by SchwertImStein@lemmy.dbzer0.com to c/programmer_humor@programming.dev
100 comments fedilink hide all child comments
 
you are viewing a single comment's thread
view the rest of the comments
[โ€“] person420@lemmynsfw.com 0 points 2 weeks ago (1 children)

Some interesting facts about excel I learned the hard way.

  1. It only supports about a million or so rows
  2. It completely screws up numbers if the column is a number and the number is over 15 digits long.

Not really related to what you said, but I'm still sore about the bad data import that caused me days of work to clean up.

[โ€“] Mniot@programming.dev 1 points 2 weeks ago

The row limitation seems, to me, like an actually-good thing. Excel is for data where you might conceivably scroll up and down looking at it and 1M is definitely beyond the ability of a human even to just skim looking for something different.

An older version of Excel could only handle 64k rows and I had a client who wanted large amounts of data in Excel format. "Oh sorry, it's a Microsoft limitation," I was thrilled to say. "I have no choice but to give you a useful summarization of the data instead of 800k rows (each 1000 columns wide) of raw data."