| A collection of mobile phones, but the iPhone changed everything..? |
The often deranged postings of yet another hacker, pretending to be an Astronomer, pretending to be a hacker who has written a book or two for O'Reilly Media.
Sunday, August 19, 2012
A drawer full of phones...
Thursday, August 16, 2012
iOS Sensors and External Hardware Masterclass
While I've run a lot of conferences and workshops over the years, it's always been on someone else's dime. Time to put my money where my mouth is, I'm going to run a workshop.
In fact I'm going to run a master-class on iOS Sensors and External Hardware. This is going to be hardware hacking for iOS programmers. It's going to be hands on, bring your Mac, bring your iPhone and make sure you've got Xcode set up so that you can deploy apps onto your device. It'll be a small group, no more than twenty, and I'll be doing a bunch of live coding.
We'll start the day talking about the internal sensors: the accelerometer, magnetometer, gyroscope and how to combine these into sophisticated applications. Here you'll really get the benefit of my physics background, because I can take you under the user friendly skin Apple have put on top of these sensors as part of the iOS SDK and hopefully give you a decent idea of what their limitations are and how they work.
Then we'll move on to talk about how to extend the reach of the on-board sensors by connecting your iPhone to external hardware. We'll look at how to connect the Arduino micro-controller platform to your iOS device, and build simple applications to control the board and gather measurements from sensors connected to it, directly from iOS. This course will give you the background to build your own applications independently, using the hottest location-aware technology yet for any mobile platform.
![]() |
| iPad controlling an Arduino board via the Redpark cable |
The workshop will be on Monday the 8th of October at the Hoxton Hotel right next to London's Silicon Roundabout. I've opened registration and I'm offering 30% off the ticket price until the 1st of September. Sign up early, and sign up often.
More about exactly what I'm going to be talking about on the workshop's own website. I've done similar things on smaller scales in the past, but this should be a lot of fun. Hope to see at least some of you there...
Monday 8th October 2012
Hoxton Hotel, London
Early Bird Price: £499 (until 1st Sept.)
Normal Price: £699
Wednesday, August 15, 2012
Mining the astronomical literature
There is a huge debate right now about making academic literature freely accessible and moving toward open access. But what would be possible if people stopped talking about it and just dug in and got on with it?
NASA's Astrophysics Data System (ADS), hosted by the Smithsonian Astrophysical Observatory (SAO), has quietly been working away since the mid-'90s. Without much, if any, fanfare amongst the other disciplines, it has moved astronomers into a world where access to the literature is just a given. It's something they don't have to think about all that much.
The ADS service provides access to abstracts for virtually all of the astronomical literature. But it also provides access to the full text of more than half a million papers, going right back to the start of peer-reviewed journals in the 1800s. The service has links to online data archives, along with reference and citation information for each of the papers, and it's all searchable and downloadable.
Number of papers published in the three main astronomy journals each year. CREDIT: Robert SimpsonIt also makes astronomy almost uniquely well placed for interesting data mining experiments, experiments that hint at what the rest of academia could do if they followed astronomy's lead. The fact that the discipline's literature has been scanned, archived, indexed and catalogued, and placed behind a RESTful API makes it a treasure trove, both for hypothesis generation and sociological research.
For example, the .Astronomy series of conferences is a small workshop that brings together the best and the brightest of the technical community: researchers, developers, educators and communicators. Billed as "20% time for astronomers," it gives these people space to think about how the new technologies affect both how research and communicating research to their peers and to the public is done.
It should perhaps come as little surprise that one of the more interesting projects to come out of a hack day held as part of this year's .Astronomy meeting in Heidelberg was work by Robert Simpson, Karen Masters and Sarah Kendrew that focused on data mining the astronomical literature.
The team grabbed and processed the titles and abstracts of all the papers from the Astrophysical Journal (ApJ), Astronomy & Astrophysics (A&A), and the Monthly Notices of the Royal Astronomical Society (MNRAS) since each of those journals started publication — and that's 1827 in the case of MNRAS.
By the end of the day, they'd found some interesting results showing how various terms have trended over time. The results were similar to what's found in Google Books' Ngram Viewer.
The relative popularity of the names of telescopes in the literature. Hubble, Chandra and Spitzer seem to have taken turns in hogging the limelight, much as COBE, WMAP and Planck have each contributed to our knowledge of the cosmic microwave background in successive decades. References to Planck are still on the rise. CREDIT: Robert Simpson.
Correlation between terms related to Active Galactic Nuclei (AGN). The opacity of each square represents the strength of the correlation between the terms. CREDIT: Robert Simpson.
Fraction of astronomical papers published with one, two, three, four or more authors. CREDIT: Robert Simpson
Compare the number of "active" research astronomers to the number of papers published each year (across all the major journals). CREDIT: Robert Simpson.Behind the project and what lies ahead
I recently talked with Rob about the work he, Karen Masters, and Sarah Kendrew did at the meeting, and the work he's been doing since with the newly gathered data.
What made you think about data mining the ADS?
Robert Simpson: At the .Astronomy 4 Hack Day in July, Sarah Kendrew had the idea to try to do an astronomy version of BrainSCANr, a project that generates new hypotheses in the neuroscience literature. I've had a go at mining ADS and arXiv before, so it seemed like a great excuse to dive back in.
Do you think there might be actual science that could be done here?
Robert Simpson: Yes, in the form of finding questions that were unexpected. With such large volumes of peer-reviewed papers being produced daily in astronomy, there is a lot being said. Most researchers can only try to keep up with it all — my daily RSS feed from arXiv is next to useless, it's so bloated. In amongst all that text, there must be connections and relationships that are being missed by the community at large, hidden in the chatter. Maybe we can develop simple techniques to highlight potential missed links, i.e. generate new hypotheses from the mass of words and data.
Are the results coming out of the work useful for auditing academics?
Robert Simpson: Well, perhaps, but that would be tricky territory in my opinion. I've only just begun to explore the data around authorship in astronomy. One thing that is clear is that we can see a big trend toward collaborative work. In 2012, only 6% of papers were single-author efforts, compared with 70+% in the 1950s.
The above plot shows the average number of authors, per paper since 1827. CREDIT: Robert Simpson.What about citations? Can you draw any comparisons with h-index data?
Robert Simpson: I haven't looked at h-index stuff specifically, at least not yet, but citations are fun. I looked at the trends surrounding the term "dark matter" and saw something interesting. Mentions of dark matter rise steadily after it first appears in the late '70s.
Compare the term "dark matter" with a few other related terms: "cosmology," "big bang," "dark energy," and "wmap." You can see cosmology has been getting more popular since the 1990s, and dark energy is a recent addition. CREDIT: Robert Simpson.Can you see where work is dropped by parts of the community and picked up again?
Robert Simpson: Not yet, but I see what you mean. I need to build a better picture of the community and its components.
Can you build a social graph of astronomers out of this data? What about (academic) family trees?
Robert Simpson: Identifying unique authors is my next step, followed by creating fingerprints of individuals at a given point in time. When do people create their first-author papers, when do they have the most impact in their careers, stuff like that.
What tools did you use? In hindsight, would you do it differently?
Robert Simpson: I'm using Ruby and Perl to grab the data, MySQL to store and query it, JavaScript to display it (Google Charts and D3.js). I may still move the database part to MongoDB because it was designed to store documents. Similarly, I may switch from ADS to arXiv as the data source. Using arXiv would allow me to grab the full text in many cases, even if it does introduce a peer-review issue.
What's next?
Robert Simpson: My aim is still to attempt real hypothesis generation. I've begun the process by investigating correlations between terms in the literature, but I think the power will be in being able to compare all terms with all terms and looking for the unexpected. Terms may correlate indirectly (via a third term, for example), so the entire corpus needs to be processed and optimised to make it work comprehensively.
Science between the cracks
I'm really looking forward to seeing more results coming out of Robert's work. This sort of analysis hasn't really been possible before. It's showing a lot of promise both from a sociological angle, with the ability to do research into how science is done and how that has changed, but also ultimately as a hypothesis engine — something that can generate new science in and of itself. This is just a hack day experiment. Imagine what could be done if the literature were more open and this sort of analysis could be done across fields?
Right now, a lot of the most interesting science is being done in the cracks between disciplines, but the hardest part of that sort of work is often trying to understand the literature of the discipline that isn't your own. Robert's project offers a lot of hope that this may soon become easier.
Friday, August 03, 2012
They promised us flying cars

Google has received Nevada's first autonomous-designated license plate. Credit: Nevada Department of Motor Vehicles
Except of course all that has come true. Google just got the first license to drive their cars entirely autonomously on public highways, Apple came along with the iPhone and changed everything, three dimensional printers have come out of the laboratories and into the home, and in a few short years, and from a standing start, Elon Musk and SpaceX has achieved what might otherwise have been thought impossible. Late last year they launched a spacecraft and returned it to Earth safely. Then they launched a another, successfully docked with the International Space Station, and then again returned it to Earth.
The SpaceX Dragon capsule is grappled and berthed to the Earth-facing port of the International Space Station's Harmony module at 12:02 p.m. EDT, May 25, 2012. Credit: NASA/SpaceX
Right now there is a generation of high-tech tinkerers breaking the seals on proprietary technology, and prototyping new ideas, leading to an rapid growth in innovation. This generation, who are building open hardware instead of writing open software seem to have come along out of nowhere. Except of course they haven't. Promised a future they couldn't have, they've started to build it. The only difference between them and Elon Musk, Jeff Bezos, Sergey Brin, Larry Page and Steve Jobs and those guys got to build bigger toys than the rest of us.
The dotcom billionaires are just regular geeks just like us. They might be the best of us, or sometimes just the luckiest, but they grew up with the same dreams, and they've finally given up waiting for the government to build the future they were promised when they were kids. They're going to build it for themselves. The same thing driving the Maker movement, and that generation of high-tech tinkerers, is the same thing that's driving the next space race.
Unlike the old space race, driven by national pride, and the hope that we could run fast enough in place so that we didn't have to start a nuclear war, this space race is being driven in part by personal pride and ambition, but also by childhood dreams.
A lot of big business seems confused by the open hardware movement, they don't understand it, don't think it's worth their while to make exceptions and cater for it. Even the so called smart money doesn't seem to get it, I've heard moderately successful venture capitalists from the Valley say that they "...don't do hardware." Those guys are about to lose their shirts. Makers are geeks like you and me, who have decided to go ahead and build our own future because the big corporations and the major governments had so singularly failed to do it for us. Is it any surprise that dotcom billionaires are doing the same? Is it any surprise that the future we build is going to look a lot like the future we were promised, and not so much like the future we'd be heading towards.
What do you do when you've changed the world? You do it again...
Thursday, August 02, 2012
The new space race
| "The impact of this adventure on the minds of men everywhere, who are attempting to make a determination, of which road they should take...", John F. Kennedy |
Dragon Spacecraft in Ocean After Splashdown from SpaceX
The SpaceX Dragon spacecraft floats in the Pacific after returning to Earth from the International Space Station (ISS). Credit: Mike Altenhofen/SpaceX
Space Stations
The first generation space stations; the Soviet Salyut and Almaz stations, along with the American Skylab station, were all monolithic designs. It wasn't really until Mir was flown with a modular design that we entered the modern era, it was the only second generation station to fly, with the US sitting on the sidelines resting on its Lunar laurels, and the Europeans seemingly uninterested in manned spaceflight.| The ISS and the docked Space Shuttle Endeavour, taken by Expedition 27 crew member Paolo Nespoli from the Soyuz TMA-20 following its undocking on May 23, 2011. It was the first-ever image of a space shuttle docked to the International Space Station. Endeavour at left. European ATV cargo carrier at right. Credit: NASA/Paolo Nespoli |
The first component of the ISS was launched in 1998, and construction began the Russian Mir station was still in orbit. The last manned mission to Mir was a privately funded Soyuz mission by MirCorp, in April 2000, which carried out repair work with the hope of proving that the station could be made safe. There was no return to Mir however which was deorbited the following year following the permanent occupation of the ISS, which began in the November of 2000.
OPSEK and Gateway
Despite being declare "complete" there are two more modules destined for the ISS are due for launch over the next couple of years, both from Russia. The Nakua module will serve as Russia's primary research module on the ISS. It will replace the current Pirs module, When that happens Pirs could become the first permanent ISS module to be decommissioned, and would be destroyed during atmospheric re-entry. The Node Module is intended as the primary core of the Russian OPSEK station. Initially attached to the ISS, it will be detached along with Nakua and some of the other Russian modules before the ISS is decommissioned and deorbitted, and used for the basis of a new station.Recent proposals by Boeing call for some of the "left over" parts of the ISS program that are still on the ground, notably the unlatched Node 4, to be used to build a Exploration Gateway Platform to be located at one of the Earth-Moon Lagrange points to be used as a launch platform for deep space exploration, robotic relay station for moon rovers, telescope servicing and a deep space practice platform located outside the Earth's protective radiation belts. The new platform would be assembled at the ISS before being boosted towards the Lagrange point. If this came about it could drastically cut the cost of future manned Lunar, Mars or NEO missions, and would represent the first manned presence beyond low-Earth orbit since the Apollo program ended in the 1970's.
Commercial operations
With the launch of first Cygus spacecraft scheduled for October of November, the number of commercial companies with access to low Earth orbit will grow to two, although SpaceX will remain the only company with return capability. There is no immediate expectation that the US government, and NASA, is on track to regain any sort of direct access and commercial operators will therefore remain the only access to space for the US for the foreseeable future.Unlike the ISS and previous stations Bigelow's station technology is different, and potentially game changing. Based on the TransHub technology and patents, which Bigelow bought from NASA when they were directed to discontinue work on module by the US Congress, Bigelow's inflatable modules will provide large useful volumes for a much smaller launch weight than traditional hard-shell modules.
By the time Bigelow is ready to launch its first station SpaceX should have a fully man-rated Dragon capsule, and possibly a crewed launch to the ISS under their belt. Earlier this month Bigelow and SpaceX teamed up to do joint marketing to international customers of crew transport on SpaceX Falcon 9/Dragon up to the Bigelow BA330 space facility.
Bigelow has agreements with seven sovereign nations to utilize on-orbit facilities of the commercial space station: United Kingdom, Netherlands, Australia, Singapore, Japan, Sweden and the United Arab Emirate of Dubai.
Of course who knows what the Jeff Bezos and his skunk-works company Blue Origin are doing behind heir "cone of silence," beyond their initial test flight back in 2006 we heard very little out of the company until the beginning of September last year where they reported the loss of their second test vehicle during a developmental test at Mach 1.2 at an altitude of 45,000ft. I'm not sure most people were aware they were testing at those altitudes, at least not at the time.
Then there is Excalibur Almaz who are now planning to take customers to the Moon, with a ticket price of $100 million a seat.
History of the Soviet Almaz military program on which the Excalibur Almaz technology is based.
Close to home
Somewhat overshadowed by SpaceX and Dragon, Virgin Galactic has announced that the FAA had given an experimental launch permit for its sub-orbital SpaceshipTwo and air carrier WhiteKnightTwo.The long duration future
The new commercial space companies have ambitious plans; SpaceX's Red Dragon which may launch as early as 2018 and use a modified Dragon capsule to carry heavy instrumentation for a soft landing on the Martian surface, and as a precursor to a manned mission.The new space race
The US and Russian governments aren't doing planning any novel endeavours in space, and it seems the Chinese are determined to tread the path that the US and Russia has taken before them, their own station seems to be a mix-and-match copy of the historical Russian programme, although the capability of their Shenzhou spacecraft to leave the orbital module behind means that their station might grow incrementally and much more rapidly than the ISS.The really interesting development work happening in the space industry right now seems to be going on in the private sector. The new space race has begun, it's between SpaceX, Blue Origin, Orbital Sciences and the other commercial companies. The goal isn't national pride, it's part personal pride and ambition, as most of these companies are founded by individuals, and part profit motive.
Monday, July 23, 2012
Interviewed at O'Reilly OSCON 2012
I'm currently on the way home from O'Reilly OSCON. While I was out in Portland for the convention I was interviewed by Mac Slocum about growth in embedded devices and the arrival of ubiquitous computing, which should be any time now... probably!
Saturday, June 02, 2012
Play testing the Lords of Midnight for iOS
In 1984 a game called Lords of Midnight written by Mike Singleton was released for the ZX Spectrum, conversions to the Commodore 64 and Amstrad CPC soon followed. It came to dominate my game playing during my mid teens, games came and went, but always I returned to the War of Solstice and the Lords of Midnight.
The Lord of Blood stands in the Keep of Blood looking north towards the invading armies of Doom Guard as they pour through the Gap of Valethor and onto the Plains of Blood. Things are not going well for the Free.
The game had a well written back story, and for the time an amazing amount of depth to the game play. A unique blend of war game, strategy, and landscape that was ground breaking...

The Lands of Midnight
...and thanks to Chris Wild's bout of nostalgia in the early nineties, and his port to MS-DOS, I went on playing the game. There was even a multi-player version of the game, called Midnight/MU built, allowing you to play online through your browser. It seems I wasn't alone in my nostalgia.
But things changed with the arrival of the iPhone, and even more so with the arrival of the iPad. I thought the iPad was the perfect platform to revive the game. While it was epic in nature, the turn-by-turn nature of the game meant that unlike some other strategy games it was well suited for the dip-in and dip-out nature of gaming on the platform. More so, I wanted to play my favourite game on my new hardware. I stopped playing Chris' port and started to think idly about porting his code, or more likely his Midnight Engine to iOS. I poked around in the source code, but eventually decided against it. Instead I waited. Someone else was going to do it, it was just a matter of time.
My patience was seemingly rewarded, there was going to be an iOS port and Chris Wild and Mike Singleton were going to work on it together...
...but time passed, actually quite a lot of time passed, more than a year, and it started to look like vapourware. Until just a couple of months ago Chris posted some video footage of the game to his blog. It existed, if only in the roughest sense, and it was playable.
The pre-alpha demo of Lords of Midnight for iOS
Content to wait at that point, I sat back. Not only was there going to be an iOS version, but because of the way Chris had ported his Midnight Engine, using the cross-platform Marmalade SDK, there was going to be a port to Android, Mac OS X and MS Windows. This wasn't just an simple iOS port, this was a cross-platform remake of the original game. There was even discussion of finally making the almost legendary missing sequel The Eye of the Moon.
I waited, I'd gotten good at it...
The Lords of Midnight for iOS
...and then Chris put out a call for play testers. I didn't spot it, but amazingly my editor at O'Reilly, Brian Jepson, did. I managed to make it into the play test, which is another one I owe Brian.

Play testing the iOS port
The graphics are still the original imagery taken from the eighties, and the interface is still a bit shaky, and there are a few bugs in artificial intelligence, but I'm enjoying having early access to the game. I'm enjoying wallowing in my eighties nostalgia.
But beyond that I think, that with the bugs and interface problems properly addressed, and the graphics updated to something that looks at home in the twenty first century, that this is still and above all a solid game. That in fact this is a game that appears as if it was always intended to be on the iPad, as if it was always meant to run on touch hardware. The new platform suits it, like a new suit of clothes.
This isn't an ageing rock star coming out of retirement for one more nostalgia tour, this is something bigger. Just like it did the first time around, I think the Lords of Midnight for iOS could change how gaming is done on the platform.
Not bad for a game that's now approaching thirty years old?
Tuesday, May 15, 2012
Getting Started with Arduino and iOS
To celebrate the release of my new video course Getting Started with Arduino and iOS, O'Reilly Media are offering 60% off when you buy it along with my book iOS Sensor Apps with Arduino.
It's the MAKE: Hardware Innovation Workshop this week, as well as Maker Faire Bay Area this weekend, and I'll be hanging around both talking about this and other things and well as doing some live demos. So come and talk to me if you see me, and you want to know more about connecting your iPhone to the open hardware world.
Location Enabled Sensors at Øredev
Back in November last year I spoke at Øredev in Malmö, Sweden, about location enabled sensors, and the video of the talk has just been put up onto the web by the organisers.
If you're interested in the topics discussed at Øredev, all the talks will eventually make it onto the website including another talk I did at the conference on visualisation which hasn't made it online quite yet.
Wednesday, May 02, 2012
Interviewed at O'Reilly Where 2012
I forgot to post a pointer to this at the time, but while I was out at O'Reilly's Where conference I was interviewed by Mike Hendrickson about location privacy, data leakage and data exhaust.


