Still Falling Down

Still Falling Down

NoSQL vs. Relational

Well, first of all, I suppose I need to have at least one blog entry per year, so this one just makes it.

For the last few months, I’ve been putting more and more data structures into MongoDB instead of MySQL, and I just put a task into the backlog to move everything from MySQL to Mongo.

I’ve worked with relational databases since 1989. Moving to an RDBMS from the indexed filesystems on the mainframe was a huge leap forward. It represented the start of the shift from overnight batch processing toward realtime data. For those twenty years I’ve been reverential toward the database component of the apps I’ve architected. I’ve spent significant upfront time putting together highly-normalized layouts with the goal of limiting schema changes as the product concept matures. Having had to do database conversions of various types, I’ve always preferred code conversions, so the idea is to overdesign the database as much as possible, and let the code catch up.

So, last year the talk around NoSQL really starts to heat up. It just doesn’t hit home for me, though. Why should I change my strategy of a highly organized data structure and switch to a primitive key-store with no JOINs, no referential integrity, and no strong entity-attribute model? Sure, I can see some nice two-dimensional structures which would benefit from a high-speed data store, but that’s what I use memcached for, so what’s the big deal?

I decided to attend MongoNYC last May. It was convenient, it was cheap, so, why not?

I can’t remember which session I was sitting in. But during that session, it hit me on the head like a licensing renewal bill from Oracle. This is an Agile development tool. If one of the important ideas behind Agile is to get a meaningful demoable feature in front of a customer or feature owner as soon as possible, then what am I doing spending all this upfront time designing a database with a dozen tables just to represent the customer contact who receives our invoice? Why can’t the Customer record (document!) just have a list of contacts? I don’t need a Structured Query language to assemble all the pieces of the document because I never tore the document into pieces in the first place. I can start writing the code, dump the data into a document, and get my prototype up and running.

So fast forward 6 months, and NoSQL gets more and more ink every day. Some well-respected MySQL people are still asking the wrong question. I know that performance has been a potent motivator behind the growth of MongoDB and the other NoSQL implementations, but the big deal here, folks, is development. For the last decade the true costs of running software have been tipping drastically towards product development costs and away from hardware and systems software costs. Unless of course, you’re Twitter, and you want to handle 50 billion text messages per minute. But for those of us just trying to build useful apps, it’s pretty cheap to throw money at performance issues. Don’t get me wrong, I love the speed that Mongo gives me. But what’s going to hit my bottom line is that I can get features out the door without an environmental impact statement for the database.

And, finally, I’m just having fun using MongoDB. Yup, I’m still in this for the kicks.

Apropos of Nothing, my $0.02 on Detroit

The “big 3″ automakers are no longer the real US auto production base. Honda, Nissan, Toyota (and their “hidden” brands) make cars for the US market here, and their sales are a significant part of domestic auto production.

The big 3 probably make more US-sold cars in Mexico and Canada then the Japanese make in the US.

And yes, I know that “make” doesn’t mean anything when parts and intermediate assemblies criss-cross the world several times before final assembly.

The UAW is terrified of the manufacturers seeking bankruptcy protection because it’s the closest the mfrs will ever get to rewriting work rules, pay scales and no-show job requirements. And all of those factors have one underlying concept: dues collection (and that cash doesn’t go to retiree health benefits, either).

If Ford, Chrysler, GM “go away”, then their brands, intellectual property (think of the hundreds of thousands of patents they hold), usable production capacity, and employable, productive people (minus their union contracts) will be snapped up at auction by the hedge funds that still have cash (yup there are a few, and I bet you could raise 4 billion in about 20 minutes to go shopping at a Detroit fire sale) or other capital-flush enterprises. Christ, if someone can invest $37million in a blog (Huffington Post), there must be capital for an automaker.

Isn’t a hedge fund or Japanese manufacturer-led bailout at $0.25 on the dollar better than a runaway train government bailout at $5 on the dollar (how much actually has to be collected from us for each dollar paid out in a bailout)? Which will result in more “real” production of US autos and a better workforce and supply chain?

Yes, hedge funds are corrupt and leaky, just like a Federal agency, but they are much more efficient at it, and they didn’t point a gun at anyone’s head to get the money.

Finally, cars made by Detroit suck. Bottom line, they fall apart, they burn gas like there’s a royalty arrangement involved, they lack features, and they’re just not as much fun to drive. If a non-Detroit car sucks, it’s likely that the suck factors will be addressed in the near future, OR, it’s OK, because you still got value for money.

Which products should the market encourage?
Bzzt. Sorry. Too late. The market spoke long ago.

Thanks for listening. When I try to talk to my cats about this, they just get up and walk away.

Come on! Let’s hear how utterly, completely, and thoroughly wrong I am! Speak up!

A chance to make the commuter tax productive

Mayor Bloomberg has used the financial crisis as an opportunity to once again bring up the issue of a commuter tax.

The State Assembly (read Sheldon Silver, who represents a district in NYC) is willing to consider the idea.
The State Senate (read Dean Skelos, who represents a Long Island district) appears unwilling to even discuss it.

I guess that leaves David Patterson as the tie-breaker.

While drastic spending cuts would be preferable to any tax increase, maybe we can come up with a commuter tax that isn’t a tax per se.

Let’s collect the commuter tax at the bridges, tunnels, and to a much lesser extent, on the suburban rail and bus lines.

I’ve mentioned this before, but let’s trot it out again.

Close the free Manhattan crossings inbound to private automobile traffic from 5AM to 3PM on weekdays. Force drivers in their own cars to pay to get into the city during working hours.
Increase the inbound toll on the remaining crossings to $40 during those times. This should be the main source of the commuter tax, and at the same time, create an incentive towards mass transit instead of the disincentive that exists now.
Eliminate on-street parking in Manhattan (below 135th Street) for private automobiles from 7AM to 8PM. Get the drivers who are willing to pay the higher toll into parking garages. Then hit them with an additional 10% sales tax on top of the existing sales tax. Manhattan residents who park monthly get a 100% exemption.

Add a 10% surcharge onto MTA and New Jersey Transit suburban line tickets coming into New York during those times. This should make up for the loss in tolls due to the increased prices, but not enough to offset the incentive.

Eliminate the outbound tolls. Get the vehicles out of Manhattan as quickly as possible.

The benefits to all this: Reduced traffic, which means lower costs for the movement of people and goods, cleaner air (reducing the cost of failing to meet federal pollution standards), reduced road maintenance costs, and best of all, fewer single-passenger SUVs blowing their horns at red lights.

I just loooove talking to myself.

New Hardware Requirements For the Next Version of Windows?

Microsoft and Cray have announced a new supercomputer that runs Windows.

I think this is a pretty good indicator of the minimum hardware requirements for the next version</> of Windows.

Read the RFCs! That’s why they’re there!

Once again, I’ve been told that an IP address can only have one PTR resource record.
We got a new Internet connection in the office, and I requested 2 PTR records for an IP address on that connection to provide reverse address lookup. Can’t have email rejected for lack of a reverse IP entry. After being ignored by Support for 2 days, I sent the request to the Account Manager, who said the request was rejected because I had 2 hostnames for one IP address, and that’s not allowed.

I’ve heard this almost every time I’ve set up a new Internet connection since 1996. I can’t believe there are techs who still think this is true.

From RFC2181 (http://www.ietf.org/rfc/rfc2181.txt):

10.2. PTR records

   Confusion about canonical names has lead to a belief that a PTR
   record should have exactly one RR in its RRSet.  This is incorrect,
   the relevant section of RFC1034 (section 3.6.2) indicates that the
   value of a PTR record should be a canonical name.  That is, it should
   not be an alias.  There is no implication in that section that only
   one PTR record is permitted for a name.  No such restriction should
   be inferred.

Let’s go folks. Just because Jon is dead, it doesn’t mean that RFCs don’t matter anymore.

Kit Kat Needs You!

From :

Calling all men! We want YOU – this kitty seems to respond more openly to gentlemen than to women. KitKat has been waiting for a new home for far too long ? since March 2007!

Kit Kat often gets overlooked ? while she is a bit sad and lonely here at Bideawee, her previous foster parent described her as a ?mushy lap cat.? She loves having her head and chin scratched, and watching the world go by from a window perch in one of our cat ?resorts.?

Kit Kat is a mellow 4 year old that was rescued from the street. Won’t you please give this lonely girl a loving, forever home?

Hiring and Applicants from Mars (or they might as well be)

Well, it’s time for me to start hiring again. And slowly, despite years of experience, I convince myself that it’s OK to post jobs on craigslist and dice and to allow the job posting pages on our website to be indexed and scraped. And I hold my breath. Because I don’t have a database backend for the application process yet (number 43 on the list of projects that were due yesterday). Because my Inbox is about to be flooded with applications. Some of them might actually be from people with a glancing, occasional relationship to the requirements in the posting. Some of them might even be within commuting distance of our offices, although most will be from a minimum of 4000 miles away.

Please, please don’t start thinking that this is some anti-immigration rant. The only person I ever met whose family has been in this country for more than 150 years was Sue S., and I think they were the advance scouting party for the Mayflower. Her family had houses (there were a bunch of them after 350 years in the same town) with 5 foot high ceilings. Immigrants are the core, the backbone, the vitality of this country. If we want to end up like Europe, as a bunch of mouldering, inbred, half-wits waiting for Doomsday, then the current trend against immigrants is a brilliant move.

Sorry, I go off like that sometimes.

Anyway, it’s not about where they’re from, it’s about where they are, and whether that location makes it even slightly possible that they could show up in the office for more than 2 hours a day a couple times per week. Oh, yes, I’m a dinosaur, a relic of ages past. I have heard that with this modern Internet thing, nobody needs to go to work anymore. We can all sit at home, jacked into a computer and it’s like the whole world is one giant virtual office.

What a load of crap. Aside from the fact that I don’t want to create a race of eyeball-radiated, anti-social, speechless robots who never have direct human contact, people work better when they are in somewhat close proximity. They talk, they enjoy each other’s company, they gain a real sense of community, and are motivated to consider themselves part of the group.

Gee, there I go again.

The job posting says we want people with multiple years of commercial, hands-on PHP and MySQL experience to work full-time, on-site in our Manhattan office. So naturally, I get resumes from Romania, Dallas (not sure which is farther away), India, and Canada from people with no experience in programming, or extensive experience in VB and Access. Some of these are readable, thoughtful applications. I try to turn them down politely. Most however, are illiterate (aside from the language differences in, say, Texas), and don’t come close to responding to the instructions in the posting, or have ‘killallbosses@yahoo.com’ as the From: address. They’re just awful as attempts to get me interested in the human behind the email.

It’s very frustrating. It shows how incredibly broken the whole hiring process is. This should be a time when you meet people who will be an asset to your organization, where you make the process of selling your company as a place to work a joy and an exciting experience for the applicant. Wait. You don’t think that the hiring process is a selling process? You sit back in your web and wait for your victims to beg appropriately for the privilege of working for you? Wow. First day on the job must be a blast with all those beaten, humiliated new employees shuffling in to their drab workplace, dreading first contact with the Dark Lord of hiring.

The person/company/extra-terrestrial invading army who can fix this horrible, demeaning, counter-productive morass will change the world. Too bad I won’t live to see it.

The Ambassador of Lindy Hop

A new book is due out this May chronicling the life and career of Frankie Manning, the “inventor” of the air-step in the Lindy Hop.

Manning was a dancer at the Savoy Ballroom in Harlem in the early 30’s. He toured with a dance troupe and appeared in films. When the popularity of swing faded, the troupe disbanded and Manning went to work at the Postal Service.

A revival of swing in the 80’s brought Manning back into the dance scene as a teacher and choreographer, where he won a Tony for Black and Blue.

The book is written by Manning with his collaborator, Cynthia Millman. Cynthia has a passion for researching Jazz dance and music. From archival records and interviews with the originators, she has amassed a wealth of knowledge, as well as a superb collection of photographs, film clips and memorabilia. Cynthia has written extensively about dance, including articles for Oxford University Press’s International Encyclopedia of Dance, and has served as consultant for numerous documentaries including the PBS Swinging with Duke. Through her presentations and demonstrations, she has also shared her passion directly with audiences in both the U.S. and Europe. Cynthia also happens to be the extraordinary librarian at the Town School in Manhattan.

Buy it here:

Powell’s
Barnes and Noble

The PATH and the Second Avenue Subway

When the Hudson and Manhattan Railroad was laying out where its tracks and stations would go, the plans included a connection to the East Side via Astor Place and then on to Grand Central Station. This segment of the lines was never built, although a short stub of maybe 50 feet was built just east of the 9th Street Station.

Now comes the Second Avenue Subway with construction contracts about to be awarded. How about completing Mr. McAdoo’s plans and building the extension out to Astor Place with transfers to the number 6 line and then Second Avenue?

That’s a pretty short line from 6th Avenue to 4th Avenue and 2nd Avenue. Even the Port Authority should be able to manage a project like that.

Aboutus.org

I came across Aboutus.org recently. I like it. They spider sites and pick just the About Us page.

Since it’s a Wiki, you can also edit your page. So if the spider picks up the wrong About Us page, or there’s more that you want to say, sign in and make it happen.

Here are my favorite AboutUs.org pages:

(of course) ;)

LinkExperts Link building ad network.

TextLink.com The LinkExperts blog.

Cowgirl CreameryMmmmmmm.

Geody.com Look around at your planet.

BollywoodSARGAM The intersection of East and West.

Got a site? Go see if you’re listed.

© 2014: Still Falling Down | Easy Theme by: D5 Creation | Powered by: WordPress