The Steve Jobs emails that show how to win a hard-nosed negotiation
- 500 million page views a day
- 15B+ page views month
- ~20 engineers
- Peak rate of ~40k requests per second
- 1+ TB/day into Hadoop cluster
- Many TB/day into MySQL/HBase/Redis/Memcache
- Growing at 30% a month
- ~1000 hardware nodes in production
- Billions of page visits per month per engineer
- Posts are about 50GB a day. Follower list updates are about 2.7TB a day.
- Dashboard runs at a million writes a second, 50K reads a second, and it is growing.
- OS X for development, Linux (CentOS, Scientific) in production
- PHP, Scala, Ruby
- Redis, HBase, MySQL
- Varnish, HA-Proxy, nginx,
- Memcache, Gearman, Kafka, Kestrel, Finagle
- Thrift, HTTP
- Func - a secure, scriptable remote control framework and API
- Git, Capistrano, Puppet, Jenkins
- 500 web servers
- 200 database servers (many of these are part of a spare pool we pulled from for failures)
- 47 pools
- 30 shards
- 30 memcache servers
- 22 redis servers
- 15 varnish servers
- 25 haproxy nodes
- 8 nginx
- 14 job queue servers (kestrel + gearman)
This week, memcached, a piece of software that prevents much of the Internet from melting down, turns 10 years old. Despite its age, memcached is still the go-to solution for many programmers and sysadmins managing heavy workloads. Without memcached, Ars Technica would likely be unable to serve this article to you at all.
Brad Fitzpatrick wrote memcached for LiveJournal way back in 2003 (check out the initial CVS commit here). While waiting for new hardware to help save the site from being overloaded, Fitzpatrick realized that he had plenty of unused RAM spread across LiveJournal's existing servers. He wrote memcached to take advantage of this spare memory and lighten the load on the site.
memcached is a distributed in-memory key-value store that uses a very simple protocol for storing and retrieving arbitrary data from memory instead of from a filesystem. To store a value, a program connects to the memcached server on the default port of 11211 and issues a series of basic commands. (Note: a binary protocol is also supported.)
PALO ALTO, Calif., May 21, 2013 — At a live event today, VMware (NYSE: VMW) CEO Pat Gelsinger unveiled VMware vCloud® Hybrid Service™, an Infrastructure as a Service (IaaS) cloud operated by VMware and built on the trusted foundation of VMware vSphere®, giving customers a common platform to seamlessly extend their data center to the cloud.
“VMware’s mission is to radically simplify IT and help customers transform their IT operations,” said Pat Gelsinger, CEO, VMware. “Today, with the introduction of the VMware vCloud® Hybrid Service™, we take a big step forward by coupling all the value of VMware virtualization and software-defined data center technologies with the speed and simplicity of a public cloud service that our customers desire.”
vCloud Hybrid Service will seamlessly extend VMware software used by hundreds of thousands of customers into the public cloud. This means customers will be able to extend the same skills, tools, networking and security models across both on-premise and off-premise environments.
All of these questions are variations on "Why did Yahoo! spend one-third of their cash on hand to buy a company that by all accounts is about to run out of money?" Read this post, and hopefully these questions will not need to be asked again!
Join the @CloudFoundry team. Now is the time! http://cloudfoundry.com/jobs
The best Paas cloud is one that you can quickly and easily contribute to. Just ask @andypiper about his post: http://blog.cloudfoundry.com/2013/05/16/want-to-contribute-to-cloud-foundry-come-on-in/
QOTD: "If there's something you can do about it, then why be upset? If there's nothing you can do about it, then why be upset?"
Last Friday Facebook blocked Path’s “Find Friends” feature over brewing spam complaints. Shortly thereafter Dave Morin, Path’s CEO, proudly stated that “Path does not spam users,” but the tactics he is defending today are the very same practices that he himself cracked down on as “spam” when he was running the Facebook Platform. I watched the crack-down from the front-row at iLike, an early Facebook platform partner.
Compare Morin’s description of Path’s “feature” to the Facebook policy that was put in place while Morin was the head of developer relations for Facebook Platform. The official Facebook policy was that apps were forbidden from doing exactly what Morin now calls “not spam”:
Build features fast. Ship them. That's what we try to do at GitHub. Our process is the anti-process: what's the minimum overhead we can put up with to keep our code quality high, all while building features as quickly as possible? It's not just features, either: faster development means happier developers.
Grab a paper bag, breathe into it and calm your ass down. You're hyperventilating because you ain't never seen a deal like this before. Now collect yourself, then keep reading this incredible description that barely serves to do justice to my 2010 Felt Gridlock 3 speed fixed gear bike. Yes 3 SPEED FIXED GEAR. Also known as the greatest bike the city has ever had the privilege of existing around.
What makes this bike so much better than every other bike that has ever been pedaled? Glad you asked. It starts with the paint scheme. It looks like Iron Man if Iron Man were a bike. That's bold, son. Curb appeal. It's probably also why some piece of trash stole the front tire that originally came with this beauty. Why didn't he steal the whole bike? Because he knew he wasn't man enough. That's ok, I replaced it with something that looks even more boss. The next thing is the genuine leather seat. My taint has had a love/hate relationship with this particular bit of the machine. But it's got those swanky brass rivets so I can't stay mad that it smashed my prostate and has likely rendered fatherhood impossible. But let's face it, I'd rather have have a bike than a kid.
What else? Let's talk about that three speed in-the-hub, fixed-gear transmission for a second. It's as gnarly as it is exotic. Like the tropical, saw-toothed platypus. Which is a species that does't even exist. Fortunately this crazy ass hub does. It offers 3 speeds, as the name implies. It also offers a terrific chance to introduce that dome of yours to the asphalt if you sleep for one single second on this beotch. So don't trip. Ride safe. Get a helmet and if you've never ridden a fixed gear bike, maybe it's time to move along, young sir because this back tire doesn't flip flop and it doesn't offer any respite. What this bike does offer is a one-way ticket to legits-ville. Find a bowling ball. Then find another one. Your nuts must be at least that big to even consider making this whip the dreamiest object to ever take up too much space in your tiny ass apartment. But you'll be filled with joy once you throw a leg over this flawless piece of American-made* cycling excellence.