See MongoDB
-
If you need to run queries that aggregate big amounts of data in a reasonable time and cost, you'll need something built for it. For example, with a column oriented file format instead of the row oriented file format found in traditional relational databases
My point is more that 90% of use cases don't need that, and for those that do, you can't just slap eg. Cassandra at it and pretend it's a relational database.
-
Sharded RDBS gets you very very far from my experience at least.
Definitely, and I'm saying that while my jobs were mostly on NoSQL and I love doing it.
-
This post did not contain any content.
But it's webscale
-
If you need to run queries that aggregate big amounts of data in a reasonable time and cost, you'll need something built for it. For example, with a column oriented file format instead of the row oriented file format found in traditional relational databases
And the key word “big” here is far bigger than most engineers need to deal with. Hell, most supposed “big data” problems I’ve seen people try to tackle are small enough to fit the whole database into memory.
-
Jumping in this, bingo. JavaScript only shops scare the fuck out of me.
Just wail til they become AI-generated-JavaScript-only shops. They're gonna be vibing like the Tacoma Narrows Bridge.
-
This post did not contain any content.wrote last edited by [email protected]
Every time I'm assigned to a project that uses a document database
"So how are you guys handling all your related data?"
Finds collection of massive JSON documents containing all the related data
"Oh boy."
-
NoSQL has always been a niche use case thing.
For some stuff, no ACID is no problem. They have their place. What I'm more suspicious of is things like Google offering distributed databases that they pretend as if they could break the CAP theorem.
What's ACID?
-
This post did not contain any content.
This is kinda absolute BS at this point, though.
Mongo has acid transactions, and has for years now. Although this is only within the same database, there are plenty of dbms (including rdbms) that don't support cross-database transactions.
Mongo also, since time immemorial, has had "write concern" to ensure that it's written to disk (to the journal) before the transaction is completed.
-
What's ACID?
https://en.m.wikipedia.org/wiki/ACID
Atomicity (something happens in its entirety or not at all), consistency (database is always in a valid state --- if the database has constraints, they will always be honored), isolation (transactions don't step on each other), durability (complete transaction is complete even if there's a power failure).
Not a database expert, my parenthetical explanations may need work.
-
But it's webscale
wrote last edited by [email protected]Wow, that video is 15 years old!
-
What's ACID?
wrote last edited by [email protected]Atomicity: either all parts of the transaction complete, or all parts of the transaction don't complete; there's no "partly complete" state
Consistency: the state of the database after a transaction is stable; all "downstream" effects (e.g. triggers) of the query are complete before the transaction is confirmed.
Isolation: concurrent transactions behave the same as sequential transactions
Durability: a power failure or crash won't lose any transactions
Traditionally, ACID is where relational databases shine.
-
And yet my Uni treats it like the biggest thing in existence. Meanwhile I've never used anything other than RDBS and Redis (only for cache), neither in private nor at work.
It always depends on the context... My current job is 100% on Elasticsearch and I'm not missing transactions at all.
-
What's ACID?
You've gotten good answers from other folks but I'll provide a ELI5:
Basically a set of rules in the database to make sure that it is immediately consistent.
NoSQL databases offer eventual consistency in exchange for speed so they are generally not considered to be ACID compliant.
Most traditional databases (MySQL, postgresql, etc.) are.
There are a couple of emerging companies that try to tackle speed for traditional databases. CockroachDB offers a postgress-based database that scales more like NoSQL while still offering ACID transactions.
TiDB is a similar company but for MySQL.
-
But it's webscale
I still suggest piping data to /dev/null during meetings to see who gets the joke
-
This is kinda absolute BS at this point, though.
Mongo has acid transactions, and has for years now. Although this is only within the same database, there are plenty of dbms (including rdbms) that don't support cross-database transactions.
Mongo also, since time immemorial, has had "write concern" to ensure that it's written to disk (to the journal) before the transaction is completed.
So is it just another database software at this point, then?
-
I still suggest piping data to /dev/null during meetings to see who gets the joke
Oh man, do i have the product for you
-
Jumping in this, bingo. JavaScript only shops scare the fuck out of me.
why is my deploy process so slow?
_=> 500k npm packages -
You've gotten good answers from other folks but I'll provide a ELI5:
Basically a set of rules in the database to make sure that it is immediately consistent.
NoSQL databases offer eventual consistency in exchange for speed so they are generally not considered to be ACID compliant.
Most traditional databases (MySQL, postgresql, etc.) are.
There are a couple of emerging companies that try to tackle speed for traditional databases. CockroachDB offers a postgress-based database that scales more like NoSQL while still offering ACID transactions.
TiDB is a similar company but for MySQL.
Not all NoSQL databases are the same. Neo4j is acid compliant, and lightning fast for complex relationships that relational databases struggle with.
-
Every time I'm assigned to a project that uses a document database
"So how are you guys handling all your related data?"
Finds collection of massive JSON documents containing all the related data
"Oh boy."
wrote last edited by [email protected]What's the problem with that? In my previous team, we had a structure with four levels of nesting where we only ever needed to query the first two levels. At first we used Postgres with normalized tables, but it was just slow as hell. Switching to MongoDB actually made our performance issues vanish.
Of course it all depends on what kinds of queries you need to run, but I don't think that large JSON documents are necessarily a problem.
-
This is kinda absolute BS at this point, though.
Mongo has acid transactions, and has for years now. Although this is only within the same database, there are plenty of dbms (including rdbms) that don't support cross-database transactions.
Mongo also, since time immemorial, has had "write concern" to ensure that it's written to disk (to the journal) before the transaction is completed.
This post is very timely because I was just introducing some new people to Mongo earlier this week and led off with "Now you might still hear people say 'mongo is trash, it's not even ACID compliant!' but those people are dumb... it's had that for years and years and is just another DBMS at this point (but not relational)"
... the last part also answers the other reply to this post. Yes.
