Open seismic processing, and dolphins

Today was the first day of the Petroleum Technology Transfer Council's workshop Open software for reproducible computational geophysics, being held at the Bureau of Economic Geology's Houston Research Center and organized skillfully by Karl Schleicher of the University of Texas at Austin. It was a full day of presentations (boo!), but all the presentations had live installation demos and even live coding (yay!). It was fantastic. 

Serial entrepreneur Alex Mihai Popovici, the CEO of Z-Terra, gave a great, very practical, overview of the relative merits of three major seismic processing packages: Seismic Unix (SU), Madagascar, and SEPlib. He has a very real need: delivering leading edge seismic processing services to clients all over the world. He more or less dismissed SEPlib on the grounds of its low development rate and difficulty of installation. SU is popular (about 3300 installs) and has the best documentation, but perhaps lacks some modern imaging algorithms. Madagascar, Alex's choice, has about 1100 installs, relatively terse self-documentation (it's all on the wiki), but is the most actively developed.

The legendary Dave Hale (I think that's fair), Colorado School of Mines, gave an overview of his Mines Java Toolkit (JTK). He's one of those rare people who can explain almost anything to almost anybody, so I learned a lot about how to manage parallelization in 2D and 3D arrays of data, and how to break it. Dave is excited about the programming language Scala, a sort of Java lookalike (to me) that handles parallelization beautifully. He also digs Jython, because it has the simplicity and fun of Python, but can incorporate Java classes. You can get his library from his web pages. Installing it on my Mac was a piece of cake, needing only three terminal commands: 

• svn co http://boole.mines.edu/jtk
• cd jtk/trunk
• ant

Chuck Mosher of ConocoPhillips then gave us a look at JavaSeis, an open source project that makes handling prestack seismic data easy and very, very fast. It has parallelization built into it, and is perfect for large, modern 3D datasets and multi-dimensional processing algorithms. His take on open source in commerce: corporations are struggling with the concept, but "it's in their best interests to actively participate".

Eric Jones is CEO of Enthought, the innovators behind (among other things) NumPy/SciPy and the Enthought Python Distribution (or EPD). His take on the role of Python as an integrator and facilitator, handling data traffic and improving usability for the legacy software we all deal with, was practical and refreshing. He is not at all dogmatic about doing everything in Python. He also showed a live demo of building a widget with Traits and Chaco. Awesome.

After lunch, BP's Richard Clarke told us about the history and future of FreeUSP and FreeDDS, a powerful processing system. FreeDDS is being actively developed and released gradually by BP; indeed, a new release is due in the next fews days. It will eventually replace FreeUSP. Richard and others also mentioned that Randy Selzler is actively developing PSeis, the next generation of this processing system (and he's looking for sponsors!). 

German Garabito of the Federal University of Parà, Brazil, generated a lot of interest in BotoSeis, the GUI he has developed to help him teach SU. It allows one to build and manage processing flows visually, in a Java-built interface inspired by Focus, ProMax and other proprietary tools. The software is named after the Amazon river dolphin, or boto (left). Dave Hale described his efforts as the perfect example of the triumph of 'scratching your own itch'.

Continuing the usability theme, Karl Schleicher followed up with a nice look at how he is building scripts to pull field data from the USGS online repository, and perform SU and Madagascar processing flows on them. He hopes he can build a library of such scripts as part of Sergey Fomel's reproducible geophysics efforts. 

Finally, Bill Menger of Global Geophysical told the group a bit about two projects he open sourced when he was at ConocoPhillips: GeoCraft and CPSeis. His insight on what was required to get them into the open was worth sharing: 

1. Get permission, using a standard open source license (and don't let lawyers change it!)
2. Communicate the return on investment carefully: testing, bug reporting, goodwill, leverage, etc.
3. Know what you want to get out of it, and have a plan for how to get there
4. Pick a platform: compiler, dependencies, queueing, etc (unless you have a lot of time for support!)
5. Know the issues: helping users, dealing with legacy code, dependency changes, etc.

I am looking forward to another awesome-packed data tomorrow. My own talk is the wafer-thin mint at the end!

Update on 2011-06-18 23:34 by Matt Hall

You can read all about Day 2 of this workshop in this blog post. 

To free, or not to free?

Yesterday, Evan and I published our fourth mobile app for geoscientists. It's called AVO*, it does reflectivity modeling, and it costs $2. 

Two bucks?? What's the point? Why isn't it free? Well, it went something like this...

- So, this new app: is it free?
- Well, all our apps are free. I guess it's free.
- Yeah, we don't want to stop it from spreading. If it wants to spread, that is...
- But does free look... worthless? I mean, 'you get what you pay for', right? Look at all the awesome stuff we pay for: Amazon web services, Squarespace web hosting, Hover domain hosting, awesome computers,...
- So what would we charge?
- What do other people charge? 
- There are no 'other people'... But there are technical apps for oil and gas out there. Most of them cost $1.99, some are $4.99, one or two are $9.99. Who knows how many downloads they get? 
- I bet the total revenue is constant: if you charge $1 and get 1000 downloads, then you'll get 100 at $10. But that's an experiment you can never do—once you've charged some amount, you can't really go up. Or down.
- How do other people decide what to charge?
- I guess traditionally you might use a cost-plus model: the cost of production, plus a profit margin.
- What's our cost of production?
- Well, a few days of time... let's call it $5000. If we wanted to make $10 000, and only expect 500 people to even be in the market... It doesn't work. No-one will pay $20 for a cell phone widget.
- Won't they just expense it?
- Maybe... I don't think the industry is quite there yet.
- Hmm... I downloaded an app for $20 once [a seismograph]. And another for $10 [a banjo tuner]. I don't even think about paying $1 or $2. That amount is basically free. $1 is free.
- But a buck... isn't it just a pain to even get your credit card out?
- Well, once you're set up in Google Checkout, or iTunes or whatever, it's essentially one click. And then we get a sense of the real user base. The hard core!
- Yeah... right now about 50% of people who install an app nuke it a few days later.
- At least if it's under $5 we probably won't have to deal with refunds and other nonsense.
- Arrgghhhh... why is this so hard? 
- Let's make it $2. 
- Let's make it free.
- But this app is awesome. Awesome shouldn't be free. Awesome is never free. Awesome costs. 
- But isn't this really just a thing that says "Agile is awesome, check us out, hire us"? It's marketing.
- Maybe... but it's useful too. It works. It does something. It has Science Inside™. People will get $1-worth out of it every time they use it. If this was a <insert energy software empire> app it would cost $10 000.
- Can we ask people to pay what they want? Like what Radiohead did with In Rainbows?
- No because they're already huge. They invoke mass hysteria in grown men. We don't invoke mass hysteria. Among anyboy.
- Damn. OK. Let's make it nearly free. As-good-as-free. Free-ish. Pseudo-free. Free*.
- $2?
- $2.

So the app costs a toonie, and we promise you won't regret it for a second. If you can't afford it, email us and we'll send you a free one. If you really hate it, email us and we'll send you $3.

More geophysics apps

Please welcome our latest app, Fold*, into the world. It is now available for free in the Android Market. This one is aimed at geophysicists planning land 3D seismic surveys. You provide some basic data about the geometry, and the tool computes fold in natural bins, and trace density per unit area. It also provides a qualitative description of what such a geometry might be good for (simple structure only, say, or high S:N or reflectivity areas). Read all about it in the wiki.

We have also put together a new page on this website, gathering news & info all our geoscience apps in one place. You will find it in the title bar above. Please share it with anyone you see using an Android™ phone or tablet!

 If you have a wish for an app, leave a comment or drop us a line!

Geophysics apps FTW

I have used an Apple iPhone for several years. It's probably the loveliest technology I've ever owned. But now it's gone, it's over between us, and it will never come back. Because now I've found Android. 

Last Wednesday I got a Google Nexus S, chosen for its relative purity: built by Samsung, it's a Google-branded phone, so it has less of the carrier's fingerprints on it, and it gets OS updates faster. But it's not the phone I love—it doesn't have the industrial beauty of the iPhone®. It's not even Google's Android™ operating system that I'm besotted with—though it is pretty fantastic. The thing I love is App Inventor. 

If you've never tried programming a computer, you really should give it a try. For me, learning to program transforms a computer from a mere tool into a workshop. Or if you prefer, from an instrument into an orchestra—sounds a bit less utilitarian that way. And I tentatively assert that you will never look at a problem, at least a technical one, in the same way again.

Google App Inventor™ is a programming environment for your phone. You do the programming in a web browser, but the thing you build runs on your phone, or anyone else's phone (as long as it's running Android, natch). Everything is free. And it's easy. Not 'quite easy'. Really easy. If this doesn't sound pretty amazing, you should probably stop reading now. 

Since last Friday, I have built four applications, three of which are geoscientiferous:

• Fold* computes fold and trace density, given a seismic acquisition geometry
• Elastic* finds all of the elastic parameters, given V_P, V_S, and density
• Volume* calculates oil in place, given some reservoir properties (shown)

I had each app working, in a basic way, inside an hour. The only slightly tricky thing is setting up the logic to handle blank fields, weird oilfield units, and that sort of thing. Aesthetics can also be fiddly, especially if you are making custom graphics. But if you skip looks and error handling, perhaps because you don't intend to give the app to anyone else, then you can be done in under an hour. 

Evan and I have barely started to explore the tools available. The language inside App Inventor is based on MIT Scratch, the building-block visual interface with a long history at MIT. The vocabulary is very rich: there are math processes, logical constructs, text handlers. You can access the phone, email, the GPS, and even the accelerometer (for instance, in our apps you can shake the phone to clear the parameters and start over). You can draw interactive graphics, scan barcodes, or build a persistent database.

The only problem we've run into so far is the final hurdle: you cannot (yet—App Inventor is still in beta) easily publish your finished app to the Android Market, so that others can download it. There are non-easy ways, and we hope to have our apps up soon. They will be free, though we may experiment with freemium. 

Next week I'll write a bit about Volume* and show you how the inside of it looks. In the meantime, give it a try... or if you prefer, let us know if there's a killer geoscience app you'd love to have on your phone. I'm on a roll!

Find out more

The Wikipedia articles on Android and App Inventor are very nice summaries. 

• There are a couple of books coming out in the next week or two: App Inventor, co-authored by one of App Inventor's creators, Hal Abelson (with others; O'Reilly), and App Inventor for Android by Jason Tyler (Wiley). 
• There are lots of blogs and forums devoted to App Inventor, such as tAIIC and App Inventor Blog. 

iPhone is a registered trademark of Apple, Inc. Android and App Inventor are trademarks of Google Inc. Agile is not connected in any way with any of these marks or companies.

Update on 2011-05-04 15:46 by Matt Hall

I am excited. I have just successfully got the Volume* app into the Android Market, so it is available for download. I am very open to feedback... I am new to more or less every aspect of this, so you won't hurt my feelings! Our sole aim is to be useful.

You can scan this QR code with your Android phone to visit the Maket and install the app.

Please have a look and rate our app in the Market!

News of the week

The AAPG Annual Convention and Exhibition was this week in Houston. Several companies took the opportunity to announce news. Here's a quick round-up.

Real time well-site mineralogy

Fugro Robertson, a UK-based subsidiary of Dutch company Fugro, introduced RoqSCAN™, a new well-site tool for real-time mineralogical analysis of cuttings. It seems to be a field-portable version of the same technology as their well-received QEMSCAN® lab-based product. Both systems are based on scanning electron microscope analysis. Exciting to see more quantitative tools for geologists. 

More gear for 3D imaging

Ingrain, the exciting 'digital rock physics lab', have bought another Carl Zeiss microscope. But not just any microscope, the AURIGA Crossbeam FIB/SEM, or focused ion beam and scanning electron microscope. Ion beams are useful because, since ions are relatively massive, they can be used to shave extremely thin layers from a rock. The SEM can build up a 3D image of the rock, as it is progressively ablated in this way. If you have never seen Ingrain's 3D images, check out their website for papers like this one (1MB PDF). Amazing.

New plug-ins for viz tool

TerraSpark Geosciences, Geoff Dorn's spin-off from the University of Colorado at Boulder, make a nice-looking piece of software called Insight Earth®. Based on ARCO/BP-funded technology, it's an integrated seismic interpretation tool that seems to have some interesting functionality (we've never seen it in action though). The news is that the company has signed an agreement with visualization gurus INT to develop plug-ins for Insight Earth. Very cool, but we can't help thinking (dreaming?) as we look around these sites: Why isn't any of this open source? 

LMKR go announcement crazy!

The Dubai-based consulting and software firm pwned AAPG, at least if your yardstick is press releases or social media presence (follow @LMKRNews). They are clearly growing aggressively, having taken on marketing and support of Landmark's very nice GeoGraphix software last fall. Watch out for them! Here's what they had to offer:

• They are hooking up with Object Reservoir, physicist and Landmark co-founder John Mouton's new company, to deliver new shale gas services 
• They have acquired Cambridge Petroleum Software's Velocity Manager software, for depth conversion functionality.
• They are adding Scrybe's weirdly-named Convofy to GeoGraphix. What does that mean? We think this may be the most momentous announcement of the year: they have added social media functionality to an integrated interpretation suite. The platform is fully mobile and supports, among other things, microblogging, document sharing, and commenting. 

Even if you are skeptical about social media, please staunch your inner cynic just for a moment and please watch this video. Think about where this last innovation could lead our notions of teamwork, especially in distributed teams. We are excited!

This regular news feature is for information only. We aren't connected with any of these organizations, and don't necessarily endorse their products or services. 

What is your competitive advantage?

What gave you an advantage once may no longer be helping you. Fortresses just aren't relevant today. Surami Fortress, Georgia.I've been thinking a lot about openness recently. Open-source software, open publishing, and open data are important themes in science today, but not really in business. I think this is going to change in the coming decade, as open-minded young professionals with openness in their blood infiltrate management. I hope Agile* is part of this shift. 

Years ago, oil companies were closed systems. They had secrets. They had large research divisions, rivalling universities in size and scope. They developed their own technology, wrote their own software. The people who worked in these companies were trained in-house, and had long careers. These companies competed with each other on an every-man-for-himself basis, with little regulatory intervention, and little more than admiration and awe from the general public, just glad for its precious petroleum.

Today's industry, however, does not look like this. The typical medium to large oil company...

• has a small research division, if it has one at all;
• lets service companies and universities do its innovation, usually as part of a consortium;
• does little in-house training, relying instead on universities and external trainers;
• buys dated, off-the-shelf software;
• has staff attrition and loyalty problems, with most people staying only a few years;
• is under substantial regulatory and public scrutiny;
• has customers who don't want or like their product, but are simply addicted to it.

In this environment the research is shared with competitors, the technology is the same as everyone else's, the employees switch companies regularly, and everything is done under the public's disapproving gaze. It is clear that competitive advantage ain't what it used to be. Yet oil companies are stuck in yesterday's mindset, hiding all their data, software, technology, and ideas, even (especially?) the ones that are generic, or useless, or just wrong. What a waste of energy.

So what is your competitive advantage? In the next post, I'll take a look at what I think sets companies apart, and what I think we can safely share. In the mean time, let us know what you think. 

Update on 2012-02-09 16:34 by Matt Hall

The follow-up post came two weeks later...

News of the week

AAPG conference starts on Sunday 

The community of petroleum geoscientists will convene in Houston in a few days for the AAPG 2011 Annual Convention & Exhibition. If any geo-tweeps will be there, spare a thought for those that aren't and update us on the events and happenings with the hashtag #ACE2011. Follow @AAPG_Events or @AAPG on Twitter. Wish we were there!

DownUnder Geosolutions coming up over

Australian based DownUnder GeoSolutions (aka DUG, at DuGeo.com) have recently announced that they will be opening offices in Calgary in May. One of the young entrepreneurs helping build this emerging technology company's was recently featured in Petroleum Exploration Society of Australia's magazine. One to keep an eye on!

CGGV have a new processing centre in Oman

The new CGG Veritas office will focus on onshore seismic acquisition and imaging services for the petroleum industry. The centre will also be hosting a university training facility in partnership with the national energy ministry and other industrial partners. In this regard, CCGV is hoping to help develop highly qualified Omani professionals.

Geoscientists without borders

The April issue of SEG's The Leading Edge features stories of the geoscience community solving global humanitarian problems. The International Symposium on the Application of Geophysics to Engineering and Environmental Problems (SAGEEP) has been formed to tackle everything from natural hazards and environmental awarness issues, to finding scarce freshwater resources in impoverished regions. Read more about how geoscientists are making a positive impact and empowering people through education and technology. Great to see this kind of out-reach.

This regular news feature is for information only. We aren't connected with any of these organizations, and don't necessarily endorse their products or services. 

News of the week

Paradigm showcases new geophysical software

Paradigm will preview its latest exploration and development software technologies and workflows at the AAPG convention 9–13 April 2011. Their agenda covers workflows for multi-disciplinary subsurface teams, next generation geologic software, and a Windows 7 interpretation platform. Paradigm is one of the sponsors of the 2011 AAPG Imperial Barrel Award student propsect competition. Follow them on Twitter: @ParadigmLtd.

Ikon Science releases RockDoc 5.5

Ikon Science has teamed up with the experts at Statoil and immersed rock physics modeling templates into the software interface, allowing users do rock physics all in one place. And with a new extension, External Interface, users can add their own C and MATLAB code to RockDoc. As a MATLAB users, we find this is a very appealing step. Click here to read more.

Third beta release for OpendTect 4.2.0

dGB Earth Sciences, creators of OpendTect, the purveyors of the Open Seismic Repository, have announced their third Beta release of OpendTect 4.2.0. The roll-out of the official version 4.2.0 is due in mid-April. If you aren't using OpendTect, why not download it, and start using this software today. And while you're at it, grab some data from the Open Seismic Repository. 

PetroChina drills first horizontal shale gas well

China sprang into the embryonic stages of shale gas exploration and development this week when PetroChina completed the drilling of its first horizontal shale gas well in Sichuan Province. It will be exciting to watch the results China strives to access its massive shale gas resources, which up until now have been beyond its technological reach. Click here to read more.

University of Aberdeen opens seisLAB

Thanks to industry sponsors BP, Chevron, BG Group, Halliburton, and Schlumberger, the University of Aberdeen will soon be decked-out with state-of-the-art geoscience software and infrastructure. seisLAB will accelerate training, research, and teaching in one of Europe's energy capitals, pushing innovation and collaboration in the field. Click here to read more.

Geo-FLOSS

Newton didn't need open source, so why do you?Free and open source software is catalyzing a revolution in subsurface science. As a key part of the growing movement to open access to data, information, and the very process of doing science, open software is not just for the geeks. It's a party we're all invited to. 

I have been in California this week, attending a conference in Long Beach called Mathematical and Computational Issues in the Geosciences, organized by the Society of Industrial and Applied Mathematicians. In 2009 I started being more active in my search for lectures and courses that lie outside my usual comfort zone. I have done courses in reservoir engineering and Java programming. I have heard talks on radiology and financial forecasting. It's like being back at university; I like it.

How did I end up at this conference? Last spring, I wrote a little review article about open source software (available here at dGB Earth Science's site). It was really just a copy-edited version of notes I had made whilst looking for free geoscience software and reading up on the subject for my own interest. After some brushes with open source, I was curious about the history behind the idea, how projects are built, and how they are licensed. At the same time, I also started a couple of Wikipedia articles about free software in geology and geophysics, as a place to list the projects I had come across. Kristin Flornes, of IRIS in Stavanger, Norway, saw the article and her colleagues got in touch about the conference.

The talk, which you can access via the thumbnail (left) or look at in Google Docs, is part FLOSS primer, part geo-FLOSS advert, part manifesto for a revolution of innovation. I hope the speaker notes are sufficient. 

What do you think? Is software availability or architecture or capable of driving change, or is it just a tool, passive and inert?

← Click the image for the PDF (6.9M)

Update on 2011-04-07 10:12 by Matt Hall

This FLOSS licensing flow chart is just too good to be true. I'd post the image, but unfortunately I can't tell how they have licensed the work (!).