/var/log/sysblog http://ljudmila.org/~julian/blog.php levelHead in Incheon, Korea. http://ljudmila.org/~julian/blog.php?entry=entry090801-014338
The Whitney's Christiane Paul is co-curating the Incheon Digital Arts Festival (warning: excessive flash menus), in Incheon, and has invited levelHead to be part of the show.

I'll be in town for just a few days setting up in time for an opening on the 7th of August. If you are (by some slivver of statistical improbability) in Incheon this time of year, stop in and see the show!

It looks like a fine lineup of work indeed.. ]]> Campus Party Valencia http://ljudmila.org/~julian/blog.php?entry=entry090730-124110


]]> Why don't you eat meat? http://ljudmila.org/~julian/blog.php?entry=entry090721-175957 I've been a vegetarian for most of my life. I also travel one or two weeks a month around Europe and abroad and while travelling I'm lucky enough to be treated to dinner. Often I find myself rejecting a plate of fish or meat offered to me, even after having made it clear I don't eat either.

It's at this point someone on the table will ask me a slew of questions around my dietary choices, a topic I'd rather avoid during a social gathering. To these ends I've written a little Q+A sheet to save people the bother.

"Why don't you eat meat? (1)"

Only to make you feel so awfully guilty about what's on your plate that you will want to strike up a debate with me, vainly hoping to crush me in a hurricane of reason and common sense that will consume the entire duration of this social gathering, alienating everyone present and ruining the evening.

"Why don't you eat meat? (2)"

Because animal meat reminds me too much of human meat and I'm really trying to quit

"Why don't you eat meat? (3)"

Because everytime I eat a cow, a puppy dies.

"Why don't you eat meat? (4)"

Why don't you live in Luxembourg?

"Why don't you eat meat? (5) Meat is a natural part of the human diet."

People started eating meat out of necessity in harsh conditions, not because braised duck-liver with a sprig of rosemary was a hit at parties.

Our bodies reflect that we haven't done it for long: unlike cats, sharks and dogs, we have never killed animals with our own hands and/or teeth. We've had to invent weapons to do so, the same weapons we used to kill other people.

Just as I do not need to kill other people, expanding or defending territory, I don't need to eat animal parts to be a healthy human.

"What's the ethical difference between eating plants and animals? Both are living. Research suggest plants feel pain".

The broader picture is that it's ecologically more sane to eat plants directly than chopping down hectares of forest to grow plants to feed them to C02 burping cows and pigs, some of which will become tissue, some of which will be eaten by humans, all at the great expense of oxygen, electricity, diesel and life. If an ethics here is to include a reduction of suffering, eating parts of plants rather than those of animals is the better bet.

All said, the difference for me is still largely personal. Prior to becoming vegetarian I lived on a small farm; I've killed and dismembered many animals. I've also killed and dismembered many broccoli. The result of my findings is that I empathised closely with animals while killing them, especially when using a knife. I didn't (and still don't) empathise with broccoli, regardless of weapon.

"If you were trapped on a desert island, and were starving, would you kill and eat animals?"

If it was a desert island there wouldn't be any animals to eat.

"If you were trapped somewhere there were animals, and were starving, would you kill and eat animals?"

Quite likely.

"If we don't eat cows they will breed and take over the earth"

It is getting late..

"It's rude to refuse the food of local cultures when offered to you, regardless of your beliefs."

It's ruder to insist on making my personal dietary choices the principal topic of discussion during a social dinner.

"Cows, sheep, pigs are part of the human food chain."

Any so-called 'food chain' reflects dietary context; I don't need to eat meat to survive in my 21st century, largely western, dietary context.

Regardless, if you think paying people to prod cows, sheep and pigs into the back of a truck, drive them scared out of their minds for miles in their own shit, lead them into a large building with men in white overalls bearing stun guns and knives reflects anything as congenital as a 'food chain', you're out of your depth..

"Supporting the Dairy Industry enslaves animals too. You're eating cheese."

You're right. I was vegan in the past for 5 years or so and while quite healthy I became thinner than I'd like. Since living in Europe I've also come to really like some of the cheese I encounter. Nonetheless, this does make me something of a hypocrite and I intend to transition back to veganism one day, this time with a better diet.

"Don't you miss meat? It must be hard always having to restrain yourself from gorging on it every once and a while."

No I don't miss it. I haven't eaten meat in so long that the smell of it provides immediate bodily confirmation that it's just nothing I would ever want to put in my mouth, no more than sticks, carpet or creamed-corn (yuck!).

"Do you mind if I eat meat in front of you? I guess it looks kind of gross."

Not at all. Thanks for asking. ]]> Four Interrupted Carparks. http://ljudmila.org/~julian/blog.php?entry=entry090717-154145








Here's a video (Vimeo) and a project page. ]]> Hambre 09: The Atocha 24 Insertions http://ljudmila.org/~julian/blog.php?entry=entry090629-183520 Hambre09 opened on Saturday at Calle de Atocha 24, here in Madrid. It was a super opening, a great turn-out and some fine work shown. Hambre'09 is open until the 5th, so if you're in the area come down and check it out, if only to see an old Madrilenan Art Deco mall before it wilts into plate-glass and brushed steel.

I've created a page documenting my contribution to the show, 'The Atocha 24 Insertions'.



You can read about it here and see an edited video here. ]]> Massive speedup in Artvertiser code http://ljudmila.org/~julian/blog.php?entry=entry090520-181441
Performance there was heavily tested in the outdoors as we swapped advertisements around the workshop area (Carrefour particularly) using a Vuzix iWear Head Mounted Display and Quickcam Pro 9000 (photos soon). When it worked it worked quite well- surprisingly so given the intensity of Murcian sunlight.

However, on the train back I had a long think about where improvements could be made. This morning I went through the code top to bottom and have managed to achieve at least a 2x speedup in the tracking and augmentation. Really quite something for generic image tracking.. It's now about as fast as ARToolKit, when tested on my Thinkpad X200, and very stable. This means we should see significant performance on smaller devices.. I'm tempted to throw it at the BeagleBoard again..

Anyway, now it's time to get out into the streets of Madrid and take it for a drive!]]> levelHead receives award at Laval Virtual http://ljudmila.org/~julian/blog.php?entry=entry090503-144223 Laval Virtual this year for levelHead. Thanks to Shirai for picking up the award. Unfortunately I wasn't able to make it to Laval this year in person. I was in Lima, Peru teaching at Interactivos'09.

My assistant Pablo flew in to set up the piece and it seems he did a good job indeed.

Other winners in the first place 'Invited' category were:

YOTARO, University of Tsukuba
Copycat Hand for All, University of Tsukuba
Space Trash, Institute of Graphics and Paralell Processing, JKU, Linz

Cheers! ]]> See you at the See Conference http://ljudmila.org/~julian/blog.php?entry=entry090414-215557 The See Conference this year in Wiesbaden presenting a paper and some of my new work. Here's a synopsis of the proceedings straight from the site itself:

"see" is back again, driven by last year's success and the extensive positive feedback we received. In 2009 the see conference will again bring together fields like design, art, new media and architecture. We will explore new approaches that are being developed to confront the flood of information and transform it into useful knowledge. As before, we've got top speakers lined up, some of whom are Aaron Koblin of Google Creative Lab, the software artist Julian Oliver, Sebastian Oschatz from MESO Digital Interiors and Eric Rodenbeck from Stamen Design. The see conference #4 will take place on April 18th 2009 at the historic Caligari Theatre in Wiesbaden.

For those of you not going be sure to catch the stream!
]]> A Video Postcard http://ljudmila.org/~julian/blog.php?entry=entry090402-015427

Video Postcard from Julian Oliver on Vimeo. ]]> Camshift OSC http://ljudmila.org/~julian/blog.php?entry=entry090331-225510 Here's a little standalone utility I put together for a couple of students while teaching at the Medialab Prado. I'm posting it here in the event someone else finds it useful..

CamshiftOSC adds network functionality to OpenCV's Camshift demo. It allows you to interactively select a region of interest within a live video stream and send the center and relative angle of that region to OSC clients (Pure Data, Blender, Processing etc) quickly and simply. In the workshop it was used for tracking the tops of people's heads but any distinct clump of pixels (an LED, a flame, a cat) can also be used.

Start it like so:

./camshiftOSC <camera index> <IP> <port>

So, if you wanted to capture from /dev/video1 and send the center of a tracked area to port 4950 to a computer 193.2.132.73 on the internet, you'd:

./camshiftOSC 1 193.2.132.73 4950

Use 127.0.0.1 if you want to send to a client on the same host.

It should compile on any Linux system with liblo and opencv installed.

To get up and running on Ubuntu or Debian systems:

sudo apt-get install libcv-dev liblo-dev

Compile it like so:

gcc -lcv -lcvaux -lhighgui -llo -I/usr/include/opencv -I/usr/include/lo camshiftOSC.c -o camshiftOSC

Be sure to play with the sliders ('VMax' especially) to get the best results.

Cheers ]]> Light, Space and Perception II http://ljudmila.org/~julian/blog.php?entry=entry090326-230647

The second edition of the Luz, Espacio y Percepcion workshops has begun!

It'll be a super few days. If you're in Madrid, drop in and witness materialisation of the following projects:

Analog hologram matrix - Emanuel Andel
Buscando Aberraciones - Óscar Sainz / Mónica Bujalance
Caleidoscopio Mutante - José Manuel González Martínez
La sombra de la duda - blablabLAB (Raúl Nieves)
Medianeras Vivas - Belén Butragueño Díaz
Through the Looking-Glass: Opening Windows in the Wall - Manuel Sánchez Gestido
Versión_Beta - David Rodríguez ]]> Portable webcam capture code with OpenCV. http://ljudmila.org/~julian/blog.php?entry=entry090321-234631 I notice that lots of people are looking for a simple and portable example of how to capture and display video from a webcam. I've written up an example in around 70 lines of code using OpenCV and C++ and posted it here in the interest that it may be useful. Because it uses OpenCV you can also use it as a capture skeleton for a computer vision application.

I've tested it on a GNU/Linux system but it should compile fine on OS\X. See the comments for how to compile and use..

Hope that helps! ]]> Appearances in two new books. http://ljudmila.org/~julian/blog.php?entry=entry090315-202204 Packet Garden in their recent book Data Flow which looks at the visual culture and divergent practices surrounding information visualisation.
As an aside you may have noticed that the packetgarden.com domain is being squatted.. Sadly I never got an email from the domain hosts about it expiring and boof, the next day it was worth a lot of money.. Please update your bookmarks to use http://julianoliver.com/pg from here on!

In other news the Swiss Arts Council commissioned a text from me on Art and Videogames for a publication called 'Swiss Design in Hollywood'. Here's the English version of the text that appears in the book (in French, Spanish and English - the latter version was heavily truncated). Here's the book itself:

.

The book is designed to accompany an exhibition of the same name, curated by Patrick J. Gyger, Director of Maison d'Ailleurs the museum of Science Fiction, Utopias and Extraordinary Journeys in Yverdon, Switzerland. Maison d'Ailleurs is well worth a visit by the way, truly an astonishing and beautifully designed museum. An archive that ought to be given room on any Ark of human culture and thought..

So it followed that Marta (check out her new book!) and I went to Valencia to visit Patrick who was opening the exhibition there. It had some great prints by illustrators John Howe, Christian L. Scheurer, Deak Ferrand, Natasha Devaud, Nicolas Imhof, Brigitte Wuest, Silvio Aebischer, Simon Christen, Nadja Bonacina, Simon Otto si Alex Ongaro.

John Howe, concept artist behind a great deal of films and games, was present at the opening. Talking with him - when he wasn't autographing a stream of books - was a rare treat and I look forward to our next meeting indeed.. ]]> Puppy love. http://ljudmila.org/~julian/blog.php?entry=entry090314-174541
The Beagle Board is our first target platform for the binoculars of The Artvertiser project. Right now I'm deep in documentation reading about how to cross compile for the device using Open Embedded.

It's a pretty incredible device, ARMv7 Cortex-8 CPU, low power drain (just 5V @ 2A), OpenGL ES support, DSP chip, HD video capable, DVI and TV out for just EUR116.00..

Goodbye Weekend.. ]]> Artvertiser Progress Report: Urban Beta http://ljudmila.org/~julian/blog.php?entry=entry090306-191945
I've just posted a video documenting the progress of The Artvertiser.

Aside from the videos below there's an additional clip of version 0.2 at work on a billboard. You can also see a new 'in world' artvert labeling system at work..

Enjoy! ]]> PacketGarden footage posted http://ljudmila.org/~julian/blog.php?entry=entry090227-025400 PacketGarden for those that have never seen it running. You can see it on Vimeo here.

Worth mentioning I'll gladly take any help I can get porting it to current versions of those other operating systems (OS X Intel and Windows Vista)! ]]> Artvertiser Developments http://ljudmila.org/~julian/blog.php?entry=entry090226-202213

I've made good progress on The Artvertiser software, with several live tests out in the field proving to be successful. Clara and Diego are working on the hardware, and to those ends we've ordered a couple of Beagle Boards for the handheld device (binoculars).


Here are a couple of videos of recent field tests:

Callao, Madrid, 18M AVI
Heinrich Heine Platz, Berlin, 16M AVI
Alexander Platz, Berlin, 51M AVI

Nokia and Google, if you're reading, feel free to send me some hardware so I can target your platforms (Nokia, your N96 and Google, an HTC Magic +/or Texas Instruments OMAP34x-II MDP Zoom w/Android would be lovely. TY!)..
]]> *bump* http://ljudmila.org/~julian/blog.php?entry=entry090226-201045
anyway, let this post signify my good intention to touch this page more often.]]> Cartofictions slides posted http://ljudmila.org/~julian/blog.php?entry=entry080924-173205 Last night I gave my lecture Cartofictions: Maps, The Imaginary and Geo-Social Engineering to a surprisingly well-attended room here at Mama, Zagreb. The talk went better than the 1.2h talk at Inclusiva-net 7 months ago (video documentation here), largely because I hadn't run amok the night before.

After the talk several people asked to see my slides and so I've made them available. You can get them here as a PDF. The folk at Mama said they'll make the audio available at some point. I'll keep you posted. ]]> missing horse. http://ljudmila.org/~julian/blog.php?entry=entry080826-012232
To cut a short story long, the $US is weak against the Euro and I need a new laptop fast, specifically the new Thinkpad T400: the ideal horse for this goucho.

If you're coming to Ars Electronica and want to make some fast money, email me and I can offer you a handsome cash incentive for buying me a laptop and bringing it with you, unboxed. Yes that's right, I just used the words "handsome cash incentive" and "fast money" on the Internet.

Oh, and if you've sent me an email at all since January this year, send it to me again..
]]> TY FILE TY SP http://ljudmila.org/~julian/blog.php?entry=entry080823-044017 FILE2008 in Sao Paulo was super. Rarely do I meet such an attentive and genuinely interested team responsible for putting an exhibition together. The tech-crew were really on-to-it and the assistants hanging out with the pieces, explaining them to people, were too: they had about 1.5k people come through one Saturday. That requires a lot of patience.

The interior design of the show was clever as were the curatorial choices overall. Anyway, FILE team, here's my belated thanks. Vivian, Paula and Daniel especially. Your festival rivals anything of its size in Europe..

Sao Paulo. Where to start - even a Paulista would ask the same. It's very diverse, at times rough, vast and complex. 20 Million humans trying to make it work in the metropolitan area (within a violently maldistributed economy) of which I met around 37. Despite being a hard-working, hard-living creed, Paulistas are socially generous; it's not a myth you can simply walk into a bar and smile your way into a fine night out.

That said, my dubious companion for most of it wasn't a Paulista. Rather, it was a certain James Powderly, ever ripe for some good old-fashioned silliness. Here's to you James. Haven't heard from you for a few days. Like many I hope you turn up soon. You were half-expecting to get shot. Let's hope my "not a foreigner and not during the games" theory stands up to your fairly respectable test ;)

A fine friend of mine Mariana hooked James up with some local writers/graffers so much time was spent with a generator, projector, laptop, camera and a laser-pointer around town at night. I learnt a lot about Pichação, the name given to a kind of street-writing that at times resembles Egyptian Hieroglyphs and is unique to Brazil (AFAIK). Each has it's own unique symbolic alphabet relative to clans. Mariana, was good to hang out with you and Lelo. Both talented and super people...]]> levelHead source code released http://ljudmila.org/~julian/blog.php?entry=entry080730-091009 After many requests and a heap of delays the levelHead source code is now publically available under the General Public License V3.0. All art assets are provided under the CC-BY-SA 3.0 license. See this install page for full instructions.

This is a release intended for developers and those comfortable with the compiling software on Linux systems. As yet there is no binary executable of levelHead.

More about that soon.. ]]> off to Brazil. http://ljudmila.org/~julian/blog.php?entry=entry080729-131238 I'm off to Sao Paulo, Brazil tomorrow for the FILE festival to install levelHead.

Let it be known i'm currently looking for reccommendations of good vegetarian restaurants..]]> Quilted Thought Organ archived. http://ljudmila.org/~julian/blog.php?entry=entry080718-190651 Quilted Thought Organ, a sound-based game/performance environment I made in 1999, here. Yes the link to the movie works now.. Ugh. ]]> Ubuntu blank disable. http://ljudmila.org/~julian/blog.php?entry=entry080714-012942 Debian for development and general computery tasks, I use Ubuntu for art installations. From my experience Ubuntu has a great track record with diverse hardware and is a reliable performer with recent versions of free software. 30 minutes and you're up and running in most cases.

One great frustration with Ubuntu in a gallery/museum context however (may be fixed in 8.04) is the aggressive screen-blanking. For whatever reason disabling gnome-screensaver and various other power-management settings relating to the screen doesn't discourage it from blanking. Yes, asking the assistant of the piece to wiggle the mouse every 20 minutes is a pretty rubbish workaround..

So, here's how to permanently disable screen blanking under X on Ubuntu (and probably any other distribution). Pop this in your /etc/X11/xorg.conf and restart X

Section "ServerFlags"
Option "BlankTime" "0"
Option "StandbyTime" "0"
Option "SuspendTime" "0"
Option "OffTime" "0"
EndSection

It's the little things..

Found here.]]> levelHead v1.0 first footage (spoiler!) http://ljudmila.org/~julian/blog.php?entry=entry080711-133852


This, the first footage of the first stable version of levelHead, was documented yesterday with a speed-run of 227 seconds ;) through the first 3 cubes.

Aside from the above Vimeo documentation, you can download the 65M OGG/Theora file here. It will play in VLC.

This video was made thanks to Blender's great new video sequence editor (finally a fast and stable Free video editor for Linux) and captured using the strangely performant 3d desktop video capture solution for Linux Bugle.

For those of you keen to get your hands on the code: it's coming soon! I still need to tidy up the literature before it ships.. ]]> anagram series: video documentation available. http://ljudmila.org/~julian/blog.php?entry=entry080707-145438

I've documented 2 'software triptyches' I made in 2006, and one I recently finished, here.

Enjoy. ]]> prix ars 2008 http://ljudmila.org/~julian/blog.php?entry=entry080619-165309 levelHead received an Honorary Mention in the Interactive Arts category at Ars Electronica this year.

Apparently it will also be on show at the Ars Electronica Centre in September.

Thankyou jury!]]> Interview in TAGMAG available for download http://ljudmila.org/~julian/blog.php?entry=entry080523-180044

I recently gave an interview for TAGMAG 6 as part of their feature on Augmented Reality. It's quite an interesting issue surveying AR from a cultural, philosphical and artistic perspective.

Get it here

If you're in Den Haag region come to TAG<> and play the best version of levelHead yet alongside some great work by other aritsts like Theo Watson and Jan Torpus.

]]> levelHead at Homo Ludens Ludens. Day 2 http://ljudmila.org/~julian/blog.php?entry=entry080421-174437


As promised, here's a gallery of images of levelHead in action on day 2 of Homo Ludens Ludens. As you can see they were taken by a far better photographer, utilizing a special feature of the camera known as 'autofocus'.. ]]> levelHead at Homo Ludens Ludens. Day 1 http://ljudmila.org/~julian/blog.php?entry=entry080420-001300


Last night at the opening was the first time levelHead has been seen in the wild. As such it's been extremely revealing watching people play it, something I've done for a few hours today.

The response has been very enthusiastic and almost all people seem to 'get' the interface pretty much immediately (with the exception of one woman using the camera to explore her nostrils on the projection at a rather inopportune moment).

That aside I'm surprised at the breadth of variance in the capacity of people to record and recall information about the room they were last in. Of the 50 or 60 people I watched play levelHead, I twice saw people demonstrate alien-savant powers in this regard, completing the first cube in under 2 minutes. Almost everyone I watched took their capacity to navigate effectively quite personally, even at times stopping to make mental notes before moving to a connecting room.

One thing I'm greatly enjoying about this piece is the ever presence of hands, made gigantic, carefully holding the cube complete with little world inside.

Aside from changing all the in-game dialogues to Spanish, I'm clear on the few tweaks I'll make for SonarMatica at Sonar08 in June. One thing is certain, the cubes will need to be an extremely durable plastic.

I've uploaded a little gallery of people playing on day 1 of Homo Ludens Ludens, one that expresses most of all just how little I understand our new Ricoh GR Digital camera (or perhaps photography in general). I'll make another one of people playing tomorrow on return home. ]]> levelHead developments http://ljudmila.org/~julian/blog.php?entry=entry080414-125632
It's been a good couple of weeks working on levelHead, in preparation for the Homo Ludens Ludens (aka "Man, the player") exhibition at LABoral, Gijon, Asturias, Spain.

The controls are far more robust and a great many bugs have been slayed (in a caring and respectful way). There are now 3 playable levels and a bunch of user-notications and other goodies that aid navigation.

At the 11th hour pix came on board to migrate the tracker from ARToolkit to ARToolkitPlus, which has worked splendidly: tracker stability is far better than it was with my previous ARToolkit implementation.

While working together he chose to go on a bug hunt, chasing in particular a graphic glitch where two rooms were being drawn at the same time. I'd written the first version with the intention of just one room being drawn at a time (one marker to be tracked for simplicity) but with the aid of a stencil-buffer he managed to make the use of the likely occurence that two or even three rooms can be seen at once:

.

Development hasn't all been in code, I also have some lovely new cubes:



So at the end of a fairly fierce two weeks of programming, levelHead is ready to be unleashed on the Asturians, where it will be installed for 5 months. For those that can't make it to Gijon, levelHead will next be exhibited at Sonar, Barcelona this year.

More about that later. ]]> Cartofictions: Inclusiva-Net keynote, 08. http://ljudmila.org/~julian/blog.php?entry=entry080314-180052 Inclusiva-Net Conference, Cartofictions: Maps, The Imaginary and GeoSocial Engineering.

It's around an hour long. Note that it has one or two mis-placed slides at around 34mins. This aside the editor did quite a good job.

Abstract:

From the earliest world maps to Google Earth, cartography has been a vital interface to the world. It guides our perceptions of what the world is and steers our actions in it. As our knowledge about the world has changed, so have maps with it (or so we like to think).

In this lecture Julian shows a darker side of map-making, covering various reality-distorting effects innate to the graphic language of cartography and how they can be easily exploited for gain.. In doing so Julian positions cartography as an abstract and influentual creative practice, rich with the power to engineer political views, religious ideas and even the material world itself.

Enjoy!

Cartofictions: Julian Oliver keynote, Inclusiva-Net, Madrid '08 from Julian Oliver on Vimeo.

Be sure to check out some of the excellent projects that came out of Inclusiva-Net this year - super stuff ppl, it was a pleasure teaching working with you all.

Big thanks to the Medialab-prado team for making it all happen. ]]> Perceptual Play: Optical Illusion Art as Radical Interface http://ljudmila.org/~julian/blog.php?entry=entry080228-202938 .. that's the name of my latest paper, prepared for the Homo Ludens Ludens conference at Laboral, Gijon, Spain in mid April. It'll be published in the symposium book alongside the work of this esteemed bunch.

Download it here. You're free to reproduce and distribute it under the terms of the Creative Commons Attribution 2.0 License.

Out of interest I'd prefer to use a license like the GNU Free Documentation License for my papers but I can't find anything that comes close while remaining suitable to theory.

If you have any ideas I'd be glad to have an email from you. ]]> first artvertiser tech demos http://ljudmila.org/~julian/blog.php?entry=entry080206-225441 More Artvertising..



The below two videos show basic live image substitution of a postcard, seen by my webcam.

This clip demonstrates playing a movie 'on' the postcard and this video demonstrates cycling through a variety of images while attempting to emulate the local lighting conditions.

It's still not as stable as I'd like but nonetheless it's getting there.

The idea, of course, isn't to substitute images on arbitrary postcards but on big billboards, bus-stops and sign advertising in cities. I do have a clip of a substitution of a road-side sign but it's a bit rubbish due to it being quite dark at the time.

As opposed to (most) other augmented reality techniques - which use specially designed black-and-white fiducial markers - here the image itself is the marker.. This is much more processor intensive than normal marker tracking.

Naturally I'd love to see this working on a mobile phone but having played with a Nokia N95 recently - perhaps the best-specc'd phone for this sort of work - it's clear that fast image detection is well beyond the scope of current phone hardware; at least at more than a few frames a second. That's not to say standard augmentation using fiducial markers doesn't work fine on such a phone (like those used with ARToolkitPlus)..

Nonetheless, a UMPC built into a pair of binoculars is probably a bit more fun out on the field anyway.]]> Announcing new project: The Artvertiser http://ljudmila.org/~julian/blog.php?entry=entry080123-155728


This is a project I've been dreaming up for a while. Only until recently however have developments in both computer vision and mobile hardware platforms made it possible to produce.

Here's the blurb:

The Artvertiser is a computer vision project exploring live, locational substitution of advertising content for the purposes of exhibiting digital artwork.

The Artvertiser takes Puerta del Sol Madrid, Times Square New York, Shibuya Tokyo and other sites dense with advertisements as exhibition space. The Artvertiser is an instrument of conversion and reclamation, taking imagery seen by millions and re-purposing it as a surface for presentation of art.

By 'training' a computer to recognize billboard advertisements, logos and other images of commerce, that content can then be 'replaced' with alternative material when seen through a specially engineered digital video device. If an internet connection is present at the site, it can be documented and published in on line galleries such as Flickr and YouTube.

So far the software component is coming along well. It is already possible to perform live substitution of billboards with images, 3D models or movies when seen through a sufficiently good camera. To get this far I've written a C++ application ontop of the excellent image tracking library Bazar that supports substituting the detected image with an OpenGL surface upon which I can draw video (live or from file) or static imagery.

Working with Clara Boj and Diego Diaz - also competent practitioners in Augmented Reality - I hope we can add a network component such that when an 'artvert' is seen in the wild it can be published to Flickr and/or filmed and uploaded to YouTube and similar video hosting services.

Soon I hope to upload videos of early trials of the system out in the wild.]]> Fijuu2 published in Chinese Art+Sci publication. http://ljudmila.org/~julian/blog.php?entry=entry080101-184111 ISBN: 978-7-03-020415-8
Press name: Science Press
Language: Chinese
660 pages (62 pages in color)

We're on pages 319 and 320 next to a couple of great works. Here's a scan the editor was kind enough to send us:



.. and here's a scan of the cover:



]]> Streaming video-textures with OpenGL and OpenCV http://ljudmila.org/~julian/blog.php?entry=entry071216-153138
Why OpenCV? OpenCV offers advanced texture processing and analysis: being able to find natural features in images on OpenGL surfaces offers up many interesting possibilities.

The trick was just to pass correctly scaled (power of 2), captured IplImage data to glTexSubImage2D every frame. It needed to be correctly formatted and bound beforehand.

Get the source code here, licensed under the GPLv3. It will compile on a Linux system. OpenCV, FreeGlut and OpenGL are needed. You'll need hardware accelerated 3D too..

Enjoy! ]]> q3apd 06 Installation documentation archived http://ljudmila.org/~julian/blog.php?entry=entry071209-124954


The q3apd project has been properly archived, with the inclusion of the LoveBytes06 Festival video documentation and galleries, here. ]]> Artist of the month http://ljudmila.org/~julian/blog.php?entry=entry071207-143730 Hyperform Net Gallery has been kind enough to make me Artist of the Month for December 07, focussing on levelHead.

Big thanks to all those involved at Hyperform. ]]> Jean Poole writes on my work http://ljudmila.org/~julian/blog.php?entry=entry071207-103500 Jean Poole was commissioned by Arnolfini to write on one or two aspects of my work over the years. Here's the text.

Thankyou Jean!
]]> Blender Manual: Modeling to Rendering http://ljudmila.org/~julian/blog.php?entry=entry071110-165512 Here's a manual I wrote introducing the basics of modeling, texturing and rendering using the excellent open-source software Blender for the FLOSSManuals project.

Later on I'll post a section on the Realtime Game Engine part of Blender toward the ends of rapidly prototyping game/3D interface ideas.

If you're interested in translating this manual into languages other than Dutch (Walter Langelaar is working on that) pls get in touch!

]]> levelhead: first beta footage. http://ljudmila.org/~julian/blog.php?entry=entry071015-182557


I've just finished the first beta (really an alpha) of my little AR/tangible-interface game levelHead. Admittedly there's not much up on the project page yet, but here's a YouTube video that conveys the general idea pretty well. It still has glitches but i'll iron those out soon enough.

At some point i also want to look into the idea of using invisible markers (have a few promising possibilities there) or full colour picture markers (also possible, though requires much more CPU braun).



Here's a better quality video in the OGG/Theora format (plays in VLC).

Enjoy.

]]> PacketGarden for Ubuntu 7.04 http://ljudmila.org/~julian/blog.php?entry=entry070802-180922 Here are packages of Packet Garden for Ubuntu 7.04.

To install just download, double-click and go. You might want to install dpkt and pycap first (also found at the above link).]]> schiele redux http://ljudmila.org/~julian/blog.php?entry=entry070731-115128
]]> fun with beep. http://ljudmila.org/~julian/blog.php?entry=entry070731-113723 Dilemma: Hotel in foreign country and must wake up very early. Phone critically low on battery, charger missing, hotelier appears to be asleep and no alarm clock in sight. Very tired, reasonably inebriated.

Fix: Write a script that emulates the sound of my phone's alarm before passing out: 

# simple alarm script.

# requires the program 'beep'

# turn up your PC speaker volume and use as follows:

# 'python alarm.py HH:MM'

import time

import sys

import os

wakeTime = sys.argv[1].split(':')

while 1:

  time.sleep(1)

  if time.localtime()[3] >= int(wakeTime[0]):

    if time.localtime()[4] >= int(wakeTime[1]):

      os.popen('beep -l 40 -f 2000 -n -l 40 -f 10000 -n -l 40 -f 2000')
]]> Unprepared Architecture at Interactivos http://ljudmila.org/~julian/blog.php?entry=entry070618-155607 Interactivos at the excellent Media Lab Madrid. I tried to spend as much time as possible there but alas had chores like setting up a new apartment. Nonetheless I had a lot of fun.

Simone Jones was one of the instructors - someone who has a great deal of experience with electronics, especially in the context of motorised cameras. Because my previously offered project proved to be unfeasible in the time frame and Simone wanted to work on something, we decided to team up.

We threw around several ideas, mostly to do with 'editing' the existing architecture of the exhibition space by adding an extra room seen only through a CCTV like display - a kind of a haunting. However, as the lighting conditions of the space were changing so frequently in the days leading up to the group-show, we couldn't pull this off. For this reason we decided to work small - really small.



The idea was simple, augment a solid cube with 6 little rooms such that the cube becomes a tangible interface for navigating through an architecture: a mind-game - "How are the rooms connected?"

I added some code to ARToolkit so that it could support occlusion - ie hiding virtual objects 'behind', or 'inside', real objects and used a simple mask object to aid the process.

Here's a little clip in the OGG Theora format (plays in VLC) that perhaps better explains it all.

Simone and I are already talking about a large version of this for a later show. In the meantime I'm adapting it into a small game where you must help a character to escape the block by leading it from room to room: by turning the cube you select the next room the character will enter. Several cubes can be used so that when a character is finally led to the exit door of one cube it will jump to the entrance of another cube (or 'level') placed nearby. I plan to make this puzzle game around 5 cubes long. More about that later..

The exhibition uses a Sony EyeToy on an Ubuntu Linux system. Worth mentioning is that I used the super Rastageeks OV51x-JPEG drivers: a 640x480 webcam on Linux for less than EUR40? Look no further!

Addendum 19-06-07 For a long list of reasons I have never found character animation a very satisfying task - probably due to me being quite horrible at it. For this reason I'm very open to collaborating with a good character animator on this project. The data needs to come from Blender via the osgCal3D exporter (shipped with recent versions of Blender).. Get in touch we me by interpreting this image. ]]> parallel universe sim gaming http://ljudmila.org/~julian/blog.php?entry=entry070520-185233
Perhaps a many worlds gaming system would involve several players with the task of governing one simulated world each. Each world starts out with an equal number of objects and agents all of which begin as perfect temporal copies of the next. Gameplay might involve triggering/steering chains of events to the ends of creating the least synchronous world - ie. sequences of highly unlikely events. The world with the least eventful similarity within a given period of time will create a branch, and that player wins. At the point of a branch, identical copies are made and the game begins again, continuing from the point of that new branch.

Perhaps the notion of 'entanglement' could also be used as a strategic means of playing great similarity to an advantage: by successfully mirroring an event in another player's world entanglement could be triggered, giving the antagonist brief remote control over events therein.

While it could easily take on the form of a 2d game or orthographic sim-like title (like Habbo Hotel) the real work would be in creating a procedural event modeling system with an internal sense of consequence and wide potential for very absurd outcomes. Scenarios for an opening game need not be large at all - ordering a falafel or getting a haircut could give plenty of material to begin with.

12-05-07 Updated for clarity.]]> 2ndPS2: Second Person Shooter (for 2 players) http://ljudmila.org/~julian/blog.php?entry=entry070505-143000 Gameworld was spent working on 2ndPS2 (read Second Person Shooter for 2-players). I'd been meaning to make this little mod for years and decided that Gameworld was as good an opportunity as any to put the idea to the test.

Unlike the previous incarnation - a simple prototype written in Blender that far too many people got excited about - your views are switched with another player, not a bot. You are looking through their view and you through theirs. When they press the key for forward on the computer, the view you're looking through responds accordingly, and vice versa. As it's all networked it's possible to play over the internet just as you would a normal multiplayer Quake3 game.

Naturally this makes it very tricky to actually play the thing as you can only navigate yourself with effect when you can see yourself: ie. you are within view of your opponent's gaze. In the few tests I did of 2ndPS2 before putting it on show people with no experience playing first-person-shooter games struggled with this reversal of the control paradigm very much, and so at the advice of Marta I built a sort of visual radar system so you could see where the other player was and vice versa.



This worked really well as far as reducing the confusion people would've had otherwise: in an exhibition context of the scale of Laboral people have very short attention spans and so a bang-for-buck approach like this was perhaps necessary. In practice it actually stood up reasonably well to these ends.

Conceptually however using this radar-helper is a bit of a compromise: why switch the views at all if you're providing a means for people to avoid engaging with a primary dislocation of perspective as an active part of the interface?

With this in mind I've decided to replace the visual radar with a sound-based system. You can hear where you are in the scene in relation to the view of your opponent - the view you're looking through. Events like walking into walls and picking up items are distinct sound events. The orientation of yourself out there in the scene is represented as changes to the pitch and harmonics of a continuous signal.

While I already had much of this auditory feedback system already implemented I didn't use it at Laboral as it was far from ready for use.

I used ioquake3 to make 2ndPS2, spending a fair bit of time coming up with new rendering effects, sprites, weapons and other bits and bobs simply because I can't help myself when I have the source code in front of me (ahh the Garden Paths). Admittedly I could've simply taken a stock Quake3 map and consdered this strictly as a conceptual piece, but when I started this I had the distinct feeling that I was beginning something much larger. Perhaps this is still the case.



Where to from here? Perhaps a mod that allows many people to play simultaneously; a hoppable second-person view matrix allowing you to change to any view other than your own. There would be a strategic component where views themselves are resources that need to be managed toward the ends of finding yourself in the arena long enough to gain control, bumping others over to a new view as required. Weapons could include a POV-grenade that shuffles all the current views of players within impact range. FOV-weapons (i've already made a couple) that suddenly throw the target into orthogonal views or warp the current camera as though the world were a rippling surface.

This sort of stuff I wanted to save for another project entirely - a strategic multiplayer game where by you must find your first-person view in a large architecturally distributed view matrix - but Eddo suggested it would probably make a pretty nice addition to 2ndPS2.



Perhaps I will do this.. I'm always open to other suggestions and even collaborations.
]]> more ioq3apaint http://ljudmila.org/~julian/blog.php?entry=entry070408-035654 Here are a few galleries, broken up into categories based on when the images were taken during the cycle of action. I think what's in here is a little more interesting than what's seen in the earlier video as it also gives coverage of some live palette manipulation.

beginnings

fields

instants

endings

]]> residency at Georgia Tech: ioq3aPaint http://ljudmila.org/~julian/blog.php?entry=entry070319-232311 VLC:



The exhibition was breif but the opening night and talk brought many thoughtful questions. Game designer and theorist Michael Nitsche was responsible for alot of great commentary, some of which he wrote about here.

ioq3aPaint develops upon q3aPaint quite heavily, introducing a fresh palette and providing audiences with the ability to cycle through palettes in real time.

Not far off is the ability to send screenshots straight to a printer; the idea being that on the opening night of a future exhibition audience could take screenshots while the abstractions evolve which are in turn sent off to a large format canvas printer. The show itself would continue the following day as a normal painting exhbition.

If you're interested in playing around with QuakeIII as a painting tool you can get fairly far working only in the console. Play with r_fov, r_drawWorld and r_showTris especially once you've 'team s' and there are a few bots in the scene. Therein start manipulating GL functions in code/render/ and drive them by adding new keybinds to code/client/cl_input.c.

A big thanks to all those in the LCC department for making it happen - an extra special thanks to Celia Pearce for setting up the initiative in the first place. Celia is one of the few people really pushing experimental game development practices in both institutional and industry contexts, and has been doing so for some years. Cheers to that. ]]> Fijuu2 interaction demonstration uploaded http://ljudmila.org/~julian/blog.php?entry=entry070317-020540

while teaching at Georgia Tech i've been in the company of some big screens, so i took the opportunity to film a long overdue clip of Fijuu2 in use.

we'd hoped for an inset of the gamepad but i didn't have access to two cameras at the time. regardless, this clip should explain what it's all about.

get it here. It's in the Ogg Theora format. If you don't know what that is, just use VLC.

]]> wiimote --> OSC --> Blender http://ljudmila.org/~julian/blog.php?entry=entry070303-213059 While here at Georgia Tech I'm giving a class on the development of 'expressive games', and for the purpose I chose Nintendo Wiimotes as the control context for class designs. The final projects will be produced in Blender, using the Blender game engine.

Only having Windows machines at my disposal I wrote a basic Python script that exposes acceleromoter, tilt and button events from GlovePIE over Open Sound Control (which is natively supported by that application) to the realtime engine of Blender. I decided to go this way rather that create a bluetooth interface inside Blender for two reasons: GlovePIE is a great environment for building useful control models from raw input, it supports the network capable protocol OSC and I wanted to keep input-server like code out of Blender (for reasons you'd understand if you used Python in Blender).

GlovePIE however is more than I need on Linux alongwith the fact I don't have a Windows machine near me most of the time. I looked into various options for getting control data from a few different 'drivers' out over OSC and into Blender. Preferring to work in Python, I tried WMD but found it too awkward to develop with, although it is nothing short of comprehensive. I finally settled on the very neatly written (Linux only) libwiimote and wrote a simple little application in C to provide what I need. Here it is, wiiOSC.

To run it on your system you'll need libwiimote, Steve Harris's lightweight OSC implementation liblo, a bluetooth dongle (of course) and a bluetooth support in your kernel (most modern distro's support popular bt dongles out-of-the-box). wiiOSC will send everything libwiimote supports (IR, accelerometer, tilt, button events etc) to any computer you specify, whether to 127.0.0.1 or a machine on the internet.

wiiOSC is invoked as follows:

wiiOSC MAC remote_host port

For instance, to send wiimote data to a machine with the IP 192.168.1.102 on port 4950, I:

wiiOSC 00:19:1D:2C:31:E1 192.168.1.102 4950

To get the MAC addr of your wiimote, just use hcitool scan. I use Blender as my listener context but you can pickup the wiimote data in any application that supports it of course, PureData, Veejay etc. To use Blender as your listener you'll need Wiretap's Python OSC implementation and this Blender file.

Enjoy.]]> Packet capture collate to log http://ljudmila.org/~julian/blog.php?entry=entry070206-020024 I've picked out the packet capture part of PG and turned it into a reasonably useful and lightweight logger that should run on any UNIX system (tested on Linux). Packet length, remote IP, transaction direction, Country Code and port are all logged. Packet lengths are added over time, so you see an accumulation of traffic per IP.

Use (as root):

./pcap_collate <DEVICE> <PATH>

This script will capture, log and collate TCP and UDP packets going over <DEVICE> (eth0, eth1 etc). the <PATH> argument sets the location the resulting GZIPped log will be written to, which will be updated every 1000 packets.

For this reason the script will automatically generate a new log on a new day and can be restarted at any time without losing more than 1000 packets of traffic.

The log is a dump of the dict containing comma separated fields structured as follows:

IP, direction, port, geo, length

It will filter out all the packets on the local network, and so is intended for use in recording Internet traffic going over a single host.

Ports to be filtered for can be set in the file config/filter.config

Stop capture with the script 'stop_capture'.

Get it here. Unpack and see the file README.txt. ]]> Chess, The Music. http://ljudmila.org/~julian/blog.php?entry=entry070202-210936

Two new projects are in the wings, the first of which I'll announce now.

This project takes a wooden chess-board and repurposes it as a musical pattern sequencer, where chess pieces in the course of a game define when and which notes will be played.

Each side has a different timbre to be easily distinguisable from the other. Pawns have different sounds than bishops, which in turn have different sounds than knights, and so on.

As the game progresses and pieces are removed, the score increasingly simplifies.

It'll be developed at Pickled Feet laboratories with the eminent micro-CPU expert Martin Howser.

]]> Packet Garden 1.0 released for Linux, Windows and OS X http://ljudmila.org/~julian/blog.php?entry=entry070201-180025 http://packetgarden.com and take it for a ride.

A big thanks to: Jerub for detailed testing of the OS X PPC port, Marmoute for the OSX PPC package, Ababab for providing PPPoE test packets and extensive beta testing of the Windows port and for his feature suggestions, Davman for beta testing the Windows port and for some fine feature requests, Krishean Draconis for porting/compiling Python GeoIP for Windows, pix for optomisation advice, Marta for both her practical suggestions and eye for aesthetic detail, Atomekk for his early testing of the Win32 port and for the Win32 build of Soya, Jiba for Soya itself and all the other people that have sent bug-reports and hung out in IRC to help me fix them. A big and final thanks to Arnolfini (esp Paul Purgas) for the opportunity to learn alot about packet sniffing , this thing called 'The Internet' and a fair bit more about 3D programming along the way. I've really enjoyed the process.

Now for something completely different..]]> it has a home on the Internet, but it's still not Net Art. http://ljudmila.org/~julian/blog.php?entry=entry070114-032258

As the topic doesn't suggest, http://packetgarden.com is now live. BETA testing is also well underway, with packages for Linux, Win32 and OS X going out the door and into the hot mits of guinea pigs. if you're also up for a little beta testing, don't hesitate to get in touch!

i've had alot of questions about this project, some about privacy, some about the development and engineering side of things. for this reason i've put up an 'about Packet Garden' page here.

Thanks to open standards, I wasn't entertaining madness undertaking the task of writing for 3 different operating systems simultaneously. That said a big thanks to marmoute for help with the reasonably grisly task of packaging the OS X beta.

< rant >

It's clear that developing a free-software project on a Linux system involves substantially less guesswork than on Windows and OS X.

Determining at which point the UNIX way stops and the Apple way begins in OS X Tiger is pretty tricky, with /System/Framework libraries often conflicting with libraries installed into /usr/local/lib or just libraries linked against locally. Because there is no ldconfig I don't have the advantage of a 'linker' and so I couldn't work out how to force my compiler to ignore libs in /System/Frameworks and link against my local installed libraries. If there is any rhyme or reason to this, or some FM I should RT, I'm keen to hear about it.

Aquiring development software on the Mac is also tricky: in Debian I have access to a pool of 16000+ packages readily available, pre-packaged and tested for system compatibility. A proverbial fish out of water, I took the advice of a seasoned Apple software developer and tried Darwin Ports and Fink but both had less than a third of software I'm used to in Debian and were both pretty broken on the Mac I used anyway. So, it was back to Google, hunting around websites to find and download development libraries. I managed to find all the software ok, but as a result of finding it online, I'm never sure which version is compatible with the system as a whole - neither Windows or OS X have any compatibility policy database or watchdog in place to anticipate or deal with software conflicts portentially introduced by software not written by Microsoft or Apple respectively. This is still a major shortcoming of both OS's I think. I can't see this happening with Microsoft in future but perhaps Apple will get it together one day and create it in the form of a compatibility database/software channel or similar that allows developers to test and register their projects for compatibility against Apple's own Libraries (and ideally those by others), sorted by license. Maybe this already exists and I don't know about it.

At this stage my development environment was nearly complete, but the libs I'd downloaded were causing odd errors in GCC. It turns out I needed to download a new version of the compiler, which is bundled into a 900Mb package called XCode that contains a ton of other stuff I don't need..

Getting a development environment up and running on Windows wasn't as difficult, though it suffers the same problems surrounding finding and installing software, let alone determining whether you're allowed to redistribute it or not; if the software I'm looking at is in Debian main, I can be sure it's free-software, hence affording me the legal right of redistribution.

One great advantage of developing on Windows again, the first time in around 6 years, is having to write code for an operating system that has such poor memory management. Everything written to memory has to be addressed with such caution that it greatly improved my code in several parts, for all platforms. Linux however has excellent memory management, and gracefully dances around exceptions where possible. Perhaps developing on Windows every once and a while is, in the end, actually a healthy excerise.

That said working with anything relating to networking on Windows is absolute voodoo at the best of times. Thankfully OS X has the sanity of a UNIX base so at least I can find out what is actually going on with my network traffic and the devices it passes over.
]]> dpkt and pypcap for Debian and Ubuntu, PPC and i386 http://ljudmila.org/~julian/blog.php?entry=entry061216-164320 Pypcap, an excellent Python interface to tcpdump's distribution of libpcap and another is dpkt.

As there were no Debian or Ubuntu packages I've packaged them and added them to a new repository where i'll host third party software i package for both these platforms in future. ]]> packet geographies http://ljudmila.org/~julian/blog.php?entry=entry061216-151220 As it eventuated, some measure of feature creep set in, but let's hope it's positive. The Arnolfini have given me more time, so I'm gladly taking it.

One addition is that Packet Garden now reports the geographical location of the remote machine you're accessing with 97% certainty, drawing information from an updated database on the host. This image shows it in action.

Detecting the geographical location of a remote host presents an interesting problem; IP block ranges are assigned to countries, but companies in those countries tend to do business over borders. So, while 91.64.0.0 might be an aggregation assigned to Deutschland, It is 'owned' and dealt out by an ISP called Kabel Deutschland. If the ISP were to expand into the Netherlands, there is nothing stopping Kabel Deutschland giving out German IP's to Dutch customers. It's at this point that taking a WHOIS lookup literally is the wrong approach.

I recently discovered that Maxmind provides a database that provides a reasonable level of accuracy under the LGPL and a Python interface to their GeoIP API. Right now this only works under Linux, but should work under OS X just fine. The Win32 version may have to wait until I can compile the lib for that plaform.
]]> packet garden update. the final sprout. http://ljudmila.org/~julian/blog.php?entry=entry061027-223545
A thousand lines of code since I last wrote, and a few hundred away from finishing Packet Garden. It's a matter of days now.

The UI code still needs some TLC - you can hear the bugs chirp at night - but there's now a basic configuration interface that saves out to a file and a history browser for loading in previously created worlds. Here's a little screenshot of the work in progress showing the world-browser overlay and the result of a busy night of giving on the eMule network.


Due to the vast number of machines a single domestic PC will reach for in a day of use I've had to do away with graphing whole unique IP's and am now logging and grouping IP's within a network range, meaning all IP's logged between the range 193.2.132.0 - 193.2.132.255 would be logged as a peak or trough at 193.2.132.255. This has exponentially dropped the total generation time of a world, including deforming the mesh and populating the garden world with flora. While I saw it as a compromise at first actually closer to an original desire to graph 'network regions'; in fact I could even go higher up and log everything under 192.2.255.255.

]]>