Big Data, A Stick

dsc05804Airplanes streaming half a terabyte of data per flight…83% of travellers having a smartphone and generating three gigabytes per month…every backoffice system storing eons of log files…

“The Big, Complicated Tomorrow has arrived” say business theorists. “It’s data-driven.”

“What’s brown and sticky?” say I.

A stick.

Because technically, tomorrow becomes reality at midnight every day. And Big Data is just a stick.

Wooden poles have been around for a very long time and so has the idea of the data-driven enterprise (the 1970s, oddly a date some iPhones consider The Big Bang of computing, meaning they crash if you try to reset them to any earlier time). Now, however, there are more sources with an increased volume flowing per information channel.

And if we live in the information age, that of tidal waves of data continuously crashing over (and into) us, what are we so well informed about? Well, I say it depends on how you apply the wooden tool.

A stick pokes, digs, and uncovers unseen gaps. Let’s take an imaginary 6-hour sector which arrives late 65% of the time in the last 2 months. Reports to Operations Control dispatchers indicate that ground staff does not have enough time to prepare the aircraft during turnaround. Ground services have reported that police have to first remove at least two drunken and unruly passengers per arrival, hence the rotational delay.

A more involving question would be “Why in the last 2 months?” Let’s expedite the imaginary discussion: catering has started to load 30% more alcoholic drinks since the start of the new season combined with “in-your-face special offer” adverts, hence higher sales and QED.

Investigating this has taken two full weeks of the OCC manager’s time. Correlating the digitalized data sources (delay times, load factor, cause of police intervention, cost of postponed ATC slot) with the (initially unsuspected) catering company reports has been a manual task, not least because incoming and outgoing merchandise gets noted using pen and paper (a copyrighted process). This assembly has been required to answer the next and most important question: how much to reduce the volume of alcohol available without impacting sales considerably and simultaneously reducing the delay which started the investigation.

Here, a digitization gap cracked open without even focusing on Big Data’s preferred fuzzy source milieu (in this example, product placement).As with all digital fads, Captain Obvious would suggest to first establish where the enterprise should be in order to create senior-level guidance.

To get you started on creating magic with The Stick, I propose an action plan:

  1. Call in an Ops Engineer, a Technician, an IT Analyst, a Flight Dispatcher, a Sales rep,
  2. Ask each one to name the biggest (in terms of volume) source of data they would not be able to live without on a Post-IT. Even better, make the preferred origin an unstructured one.
  3. Stick these on a white-board table with the following columns:
    1. name, source, size, data type, transmission mechanism, storage point
  4. Ask each one to name what that parameter could be used for if anything could be done with it. Inter-connected (aka chewed) with others into a KPI,printed on a banner at the entrance, fed to an unstructured data analyser: anything.
  5. See if (and let me know if) anything interesting comes out.


Flight Operations Challenge…Accepted.

The Future ain’t What It Used to Be

Flight Operations circa 2058

Robots. I see robots everywhere.

Not only of the humanoid variety but as nebulous electronic brains that autonomously control all aspects of an airline’s daily operation.

The year is 2058 and humans have obscene amounts of free time. The person hiring you (people being involved face-to-face only in the last stage of the 3-step process) had one question: “How do you deal with long periods of idle isolation?” Because, in flight operations, you spend most of your time in ennui.

You are a flight dispatcher responsible for 149 flights (the difficulty of maintaining relationships with more than 150 entities, aka Dunbar’s law, has dictated this limitation). You use an interactive touch-screen wall showing flights with detected irregularities that allow a final human intervention based on estimated cost impact. You only need to weigh in whether passengers, crews, or machines are most important once the company has to spend beyond a certain threshold because small-change resolutions have been automated since 2031.

Additional human help still remains available remotely because a final confirmation from the human manager remains a requirement. These dozen highly-experienced, overpaid dispatchers have created a 24h support group (some might term it “an organized crime syndicate”) by being based in different parts of the world, ready to connect to any operations’ systems and assist e.g. when simultaneous rerouting decisions on a million passengers need to be executed instantly.

The era of mass movement without human interaction has taken over Operations Control Centres. Crew dispatchers do not exist anymore since crews have been replaced by robot pilots and passenger caterers. A few exotic regional operators still employ humans in the flight deck and some VVIP operations add on friendly, warm-blooded cabin attendants but higher C2 costs mostly dictate their demise by 2088 (as predicted by the CEO humanoid executive assistant based on assumptions for how markets will develop confirmed by the executive; one of 14 people in the 100-planes-fleet of an airline). Autonomous flight bus drivers have been widely adopted in high-speed equipment replacement excused by a proven 0.0 accident track record for 20 years (turns out that graph’s horizontal axis wasn’t an asymptote) and a reduction in the primary motivator for air travel (ticket price) assisted by well-manipulated government subsidies.

Technicians have also become hermits with long beards. Robots inspect the flying machines and repair most issues by deciding on actions automatically. The human gets involved only when a final, pre-programmed request for approval appears. Not many natural brains need intervene in this one-tap affair based on a reliability KPI dashboard.

In fact, since Amazon proved an entire cargo operation can be handled by 17 (P.P.S. see below) people with a big-data centre and ad-hoc “gig economy” assistance (that term being “so 2015”), human involvement in commercial passenger operations has been shrinking in a perpetual efficiency-optimisation drive. Mundane but essential tasks have inevitably been factory-style automated. Ground handling (baggage processing, passenger assistance, cleaning, catering provisioning): robotized or converted to self-assistance. Ticketing, check-in, terminal-side support: intelligent humanoids everywhere.

Audits though, are still in human hands. Creative marketing, legal disputes, international relations management, start in the minds of hominids and complete under the metal hands of androids. Those replaced have accepted to instead voluntarily fly to promote how great Intelligent Robot Airlines are. And stay with other volitionists.

Think I am exaggerating? Writing down what’s on everyone’s mind?

“Just because you don’t know what the future will be does not mean you can’t imagine what you want it to become.”

Flight Operations Challenge…Accepted.

P.S. I only chose 2058 because that’s the year I plan to retire from flight operations.

P.P.S. Rough estimate: 1 CEO/COO/CCO; 2 network planners, 2 revenue managers (also international relations and part time sales), 1 sales (part-time PR), 2 marketing managers, 1 HR & admin manager, 2 dispatchers, 3 technicians, 1 technological assistant, 1 quality controller, 1 legal.