I am thinking of a personal server which has simple consumer facing software which you can effectively drag install, applications like Mint and Fever are a good step in this direction. Certainly Simon Wardley has been arguing in this direction for a while. This thinking has been inspired by looking at the iPad, by reading Charlie Stross' Accelerando and Daniel Suarez's Daemon. Put in a more direct manner, where is the iPad server app store?

What exists at the minute? Server side applications are by and large aimed at developers and sys-admins. WordPress and Movable Type are probably the closest to widespread consumer apps. Other than Mint and Fever apps mentioned earlier, which are aimed at geeks. The vast majority of server installable applications are for other software developers, not a small market, but not mainstream. There are lots of options for these kinds of app Amazon AMIs, virtual MovableType or what Cloudera are doing with Hadoop and the vast array of VMware products. Most if not all of these apps are free and the money is made from consulting and service contracts.

I'm also not really thinking of Google App Server or similar easy development environments, nor just RPM / CPAN / MacPorts "apps" for geeks. Perhaps something like Apple's Remote Desktop with applications packaged as installing DMG files would be a step in the right direction. There are MySQL installs as a DMG, plus many others. These are an improvement over make and make install, but they are not apps in the same light as Mint above, nor as invisible as an iPhone app install. There are tricky issues to solve including the at least four different platforms for which virtual images are created, making these is not trivial.

What is required to make a consumer server side app store possible or even desirable? It needs to be simple to install, eg drag and drop to install. Then quick to configure. Tools like webfinger (protocol) will automate people lookups, these are the kinds of hooks that will simplify setup, I'll come back to this later. I imagine these tools will be personal always on data processing tools. Rather than having a server at the end of your ADSL line you'll have a managed instance of a virtual server in a colo somewhere. They could be the wearable computing of scifi fame, but i suspect that phone as sensor with data processing in the cloud is more likely. The ability to easily move these apps and their data from one service provider to another is vital. Another lock-in is not desirable, I think it is more important with these data rich applications than with iPhone apps. Plus this kind of data portability is widely supported for server apps, eg SQL, imap, commonlog files etc.

At XTech in 2008, Steven Pemberton gave a talk on hosting your own data amongst other ideas, which Jeremy Keith wrote great notes on. The ideas in this talk won't leave me alone, go and read it if you've not come across it. I see identity services as a driver for these tools be you@yourdomain rather than gavin1234@centralizedservice.com, single namespaces get filled up pretty quickly. The web is young still, 16 years old in public awareness. What will new users of Twitter or Facebook or Linkedin have as options for names in even five years? Many people already get a vanity domain with email, but imagine a distributed twitter (fethr?) or linkedin, facebook etc. The laconica / identica project, aka status.net is heading in this direction too, imagine this running on your WRT54G or FON router.

Some other ideas that spring to mind. A web proxy that looks at every thing you read online and finds updates, references etc based on the url stream it receives and processes, there was a mac app that did this locally, can't remember name. This might find prices on things you've looked at; locate good books etc on things you search for or recommended blog posts on other things you've read. There is another set of apps in the pachube mode, processing the increasing array of sensor data that we are generating, location based data is one popular area now, but there are many more coming soon, eg smart meter data.

Another possibility is the delegated you that could exist, we have this to a limited degree already in terms of free/busy statements for calendars. Can we extend this to some sort of basic automated decision making capability on our behalf, this already works well using an multi-agent based model for the estar system, which allocates time on automated telescopes worldwide. I've mentioned brokerage agents before in terms of delegating authority, but now there are proposals for OAuth delegation to support these kinds of ideas. Combined with webfinger and knowledge of who your friends are via an address book a service like this could process some social application invites automatically. Extending this why doesn't my copy of MovableType or Wordpress know who I am? these are generally single user software, so it should be aware of who my friends are, perhaps acting as a whitelist for comments as a small example.

Lastly (and more wildly) are there sufficient personal volumes of data to warrant a hadoop / hive / mahout application for an individual? Trawling the friend of a friend and wider internet for useful information based on a model of your interests? A kind of intelligent RSS reader, perhaps based on the estar multi-agent ideas. That few of us have an ongoing data processing agent watching the web for us bothers me. Where are the intelligent agents of sci-fi fame? Douglas Adams suggested the monk plus which dealt with the world so that you don't have to, a delightful creation. One of those which helped me deal with the world would be very welcome. James Bridle's lovely sxsw book is another good example of the kinds of things these agents might make for us, give it the conference you are going to and the flight your flight plus hotel and a guide pops out tuned to your friend, location etc.

I think these are coming soon, the recent efforts from Google give strength to that, but a single provider lock in is not desirable. How do we make these apps exist and make them easily portable?

I've read that there is a small segment of iPhone owners who bought it for the internet everywhere computing device I mentioned in a previous post. For some people the iPhone was their only computer, it mostly works in that mode too, as long as your needs are not great.

Backup is the aspect that is not covered. The announcement video and details on Apple's website give some information, but I suspect there is more to come. One suggestion which comes to mind involves additional hardware from Apple. They already have the Time Capsule device for automatic backup of a Mac and it works as a wireless hub too. I can see a wireless access point with a 1-200GB drive inside, plus a dock connector as a single device from Apple. It would provide backup when docked, wireless access when not and a place to charge the iPad overnight.

We are not yet at the point where internet backup restore is that feasible, most people still have 512k ADSL at home, rather than ADSL2+ rates of up to 24meg. Also the customers for this machine are not likely to be the purchasers of high end internet access. A simple backup device like this sticks with the simplicity approach which the iPad offers, plus it gives Apple another profit rich accessory for them to sell.

The Time Capsule already has a USB port, I'd expect a cheaper version of with iPad support using this USB port to be released. Potentially the dock version I mention above and software support for the current models as a USB led iPad backup. 1TB is a bit excessive for a 16-64GB device and $299 is two thirds of the cost of the iPad. Apple may decide to push for more MobileMe subs though and an internet based backup system. Restoring 64GB over basic ADSL is going to take a while... So a smaller and cheaper Time Capsule would be a better match.

What struck me was instead something about the iPhone. The most significant enabling aspect of the iPhone launch was the unlimited cellular and then later 3G access. It was this ubiquitous access to the internet which drove the continuing demand for the device. This allowed you to check your email, the web, twitter everywhere, plus allowed every app to assume the internet would be there. Imagine an iPhone where you counted every byte you used, I had plenty of phones like that from Nokia on Orange, grim and rarely used.

I believe that this is what Apple are trying with the iPad. I read a lot of science fiction and no where in the plot does someone worry about paying for access to the communal network. It is a given. Just like Apple simplified (forced) the pricing model for 3G phone access I think this is what they are driving at here. No contract, two levels a month for access, compared to 24 month fixed contracts which are the norm from telcos.

Always on, everywhere, unmetered access will change how computers are used, just the same way as the iPhone changed how phones are used, maybe not to the same degree, but it is a shift towards the computer as part of live for everyone, not just geeks with dongles.

It has been pretty peaceful here too, but as is the way of the new year, I will hopefully change that. I've joined up with the write more project52 which should result in a blog post a week. That would be the first time since 2003, so we'll see. Writing the book has given me a taste for it, but I've not had the time other for much other than the book / job / family, then moving house took over my other spare time.

The other idea I've had is the quarterly project. I hope that three months is enough time to get one of the ideas floating around my head linked to one of the domain names I've bought and pushed out into the wilds. Briefly extending this, I mean to create a simple web app that does something useful for me and hopefully a few other people too.

The intent was to make something that would give you a guide to a new local area, the context was something that a council might send out to you a few times a year. There is a huge amount of interesting information gathered by Government, but what we usually see is aggregated, averaged and sometimes skewed to tell a message. Taking the data and linking it directly to a postcode makes this data more impartial and meaningful, which leads me on to the gist of this post. Freeing up the postcode to census output area data as a freely available API, I'll explain.

Much of the data collected at a Government level is gathered at quite a fine grained level. The lowest level of this data collection is the output area. An output area is quite a small parcel of land, for my work it is essentially the canal basin behind my office. To see this, head over to the Neighbourhood Statistics website and type in N1 9XW on the lefthand panel, click on the More areas link and select the output area radio button. The Neighbourhood Statistics website discourages direct linking, so this direct link to N1 9XW might well fail. The ONS have a helpful guide to UK geography too.

However this Neighbourhood Statistics website is a gold mine of useful information. plus it offers a key conversion from postcode to output area. Land is hard to describe, for the patch of land your chair is sitting on there are many different levels of descriptor. Some of these are point based like latitude and longitude which allow placing on a map. Most of the descriptors for Government data are boundary based. The output area is one of these. It is the smallest parcel of land that the Census collects data for. Once you get the output area though you can then find out the higher area entities like which MP constituency or Health Trust you are inside. The data behind this is all available for free from the ONS, but for internal use only.

The whole process to figure out your MP goes something like this. Enter postcode, map to output area, from there determine which ward and thence which constituency you are living in. It gets more complex if you don't know your postcode or if it has changed recently. The Royal Mail PAF (postcode address file) is the key to managing postcodes, it links postcodes and addresses. The names of the areas of land are managed by a gazetteer which links names to boundaries and will often include older names for areas, eg the old counties of England no longer exist at an authority level, there are all now different types of council.

Coming back to the simple case of knowing your postcode, there are a lot of concerns about access to this data, including campaigns to free the PAF file, which got a pretty lukewarm response. The Royal Mail own the PAF file and the Ordnance Survey own the Boundary line data, so between them they seem to have the entire thing sown up, but the mapping of postcode to output area is the property of the ONS. It is available free of charge from them, go order a copy now. You can use it internally as much as you like.

While that is useful, what I'd like to see is the lovely service on the Neighbourhood Statistics website made available as a REST API. Give it a postcode and get back JSON listing the output areas and upwards it falls into. The data is all on the results pages for the site and as the site states Boundaries for Output Areas (OAs), Lower Layer Super Output Areas (LSOAs), Middle Layer Super Output Areas (MSOAs) and Travel to Work Areas (TTWAs) are available free of charge to all users.

Making it available as a postcode to Output Area API unlocks all the Government data that the data.gov.uk project intends to release. I feel that this should be the responsible attitude of a Government committed to an Open Data initiative. Releasing the Postcode to OA does not free maps from the OS, nor give address details which the PAF file covers. Yet it provides an immense value to online civic projects.

Walthamstow is on the top. The brown patch is Walthamstow Cemetery, there is green space, but not a lot and it is in smaller patches.

Aldersbrook is below with Wanstead Flats to the south, Wanstead Park to the north and east. From Wanstead Flats you can cycle right up into Epping Forest, pretty much all in forest. These are half size reproductions of the original 600 odd pixel images, click to see them larger. The difference in the amount of green space amazed me, though the stripes to the north are a private golf course.

There are some trade offs, zone 4 on the Central line, as opposed to zone 3 on the faster Victoria line and a mid station rather than at the end of the line. It is also a good walk to the tube station, but we have a long walk to get to nursery at the minute, so not as much of an increase, every journey though. Still in London too, E11 or E12 postcode, the postcode boundary is in the middle of Aldersbrook for some odd reason, the council boundary hugs London Cemetery, which is the green portion on the east.

Quite looking forward to moving, we sold our house last week, well subject to contract. It'll be my first time living properly east of GMT too. Lastly, discovering that there was a places page for on Flickr for Wanstead made me happy.

The key thing that changes is the ethernet MAC address of the machine. This is the low level network identity which is used prior to getting a proper TCP/IP address for use on the internet. They are (I think) unique per machine and so they are used as a key for all sorts of things. Two I have found so far are Time Machine and MobileMe syncing.

Neither of these services warns you, they just stop working, which is quite irritating. To fix Time Machine you need to reselect the drive you are backing up to, this should work, but didn't for me.

For MobileMe you need to go to the Sync tab in the MobileMe preferences and tell it that the old machine name is really the same as the new one. Then you'll get to merge the data.

It is a pity that macosx doesn't recognise that it has a new motherboard and offer to fix these for you, but hopefully this list will help you one the right path to getting things back to normal.

"the evolving world, the world of hidden persuaders, of the communications landscape developing, of mass tourism, of the vast conformist suburbs dominated by television – that was a form of science fiction, and it was already here".

Just as relevant today, quote taken from The Guardian obituary, itself taken from a longer interview with JG Ballard from last summer.