Saturday, March 17, 2012

Workshop on Non-linear Interdependence Measures in Neuroscience

I'm pleased to announce the NeFF-Workshop on Non-linear and model-free Interdependence Measures in Neuroscience and TRENTOOL course which will be held at Goethe University Frankfurt, Germany on April 26-27, 2012 (hosted by the MEG Unit of the Brain Imaging Centre, Frankfurt).

The synopsis from the workshop announcement is as follows:
Understanding complex systems composed of many interacting units, such as neural networks, means understanding their directed and causal interactions. If the units in question interact in a nonlinear way, as it can be assumed in neural networks, we are faced with the problem that the analysis of interactions must be blind to the type of interaction if we want to cover all possible interactions in the network, as we may not know the type of nonlinear interaction a priori. Prematurely limiting our search to specific models, nonlinearities or, even worse, linear interactions may block the road to discovery. Novel model-free techniques for the quantification of directed interactions from information theory offer a promising alternative to more traditional methods in the field of interaction analyses, but also come with their own specific challenges. This symposium brings together the most active researchers in the field to discuss the state of the art, future prospects and challenges on the way to an model-free, information theoretic assessment of neuronal directed interactions.
I'm happy to be co-organising this workshop with Michael Wibral (head of the MEG Unit, Brain Imaging Center, Goethe University Frankfurt) and Raul Vicente  (Frankfurt Institute for Advanced Studies).

We've got several speakers lined up to talk about their work in this field, particularly using information-theoretic tools including the transfer entropy. The speakers include some collaborators of mine (e.g. Mikhail Prokopenko, Paul Williams), many others I'm looking forward to meeting (e.g. Stefano Panzeri, Luca Faes), and the organisers of course :).

Plus there will also be a workshop on Michael and Raul's Transfer Entropy toolbox (TRENTOOL), which is designed to provide effective network analysis on neuro data sets in Matlab. I'm looking forward to playing around with this more myself, I've already got a project and some data in mind.

We're hoping to get lots of participants (though space is limited) - full details on how to register are available at the workshop website - http://www.neff-ffm.de/de/veranstaltungen/seminars/workshop.php

I hope to see you there!

Sunday, March 4, 2012

Identifying influential spreaders and efficiently estimating the number of infections in epidemic models: a path counting approach

The news at this end is that Frank Bauer and I just submitted a new preprint on arXiv:

F. Bauer and J.T. Lizier, "Identifying influential spreaders and efficiently estimating the number of infections in epidemic models: a path counting approach", MPI MIS Preprint 1/2012, arXiv:1203.0502, 2012.

We introduce a new method to efficiently approximate the number of infections resulting from a given initially-infected node in a network of susceptible individuals, based on counting the number of possible infection paths of various lengths to each other node in the network. We analytically study the properties of our method systematically, in particular demonstrating different forms for SIS and SIR disease spreading (e.g. under the SIR model our method counts self-avoiding walks). In comparison to existing methods to infer the spreading efficiency of different nodes in the network (based on degree, k-shell decomposition analysis and different centrality measures), our method directly considers the spreading process, and as such is unique in providing estimation of actual numbers of infections. Crucially, in simulating infections on various real-world networks with the SIR model, we show that our walks-based method improves the inference of effectiveness of nodes over a wide range of infection rates compared to existing methods. We also analyse the trade-off between estimate accuracy and computational cost of our method, showing that the better accuracy here can still be obtained at a comparable computational cost to other methods.

The problem that we are addressing here is two-fold, and applicable not just to disease/epidemic spreading but also other information spreading models (e.g. rumour spreading):

  1. How to efficiently estimate the number of infections resulting from a given initially-infected node in a network of susceptible individuals?
  2. What network structural properties local to the initially-infected node are most useful for prediction of its spreading efficiency?
The most obvious and direct way to estimate the number of infections is to simply run simulations of the infection model - the big issue with this however, is that it takes a lot of computational time. For example, for an SIR (susceptible-infected-removed) model we run on a network of 1133 nodes and 5451 undirected edges, 1000 simulated initial infections per node for around 20 values of infection rate β took 50 minutes to simulate. And of course, this runtime does not scale well with the size of the network. So this gives us problem 1.

As such, there has been a lot of work recently trying to find local network properties of nodes that are useful in predicting the relative spreading efficiency of different initially-infected nodes in a network. This attempts to address problem 1, but additionally gives very useful insight into how local network structure can promote or inhibit disease spreading (i.e. problem 2). The properties other authors have investigated range from simply examining out-degree, to k-shell analysis, to various measures of node centrality in the network (e.g. eigenvector centrality). And the good news is that you get a surprisingly accurate insight into the relative spreading efficiency of the various nodes. Such work has attracted a lot of attention, for example being published in Nature Physics.

However, we observed two issues with these approaches:
  1. They only infer the relative spreading efficiency of initially infected nodes; i.e. they do not provide an estimate of the actual numbers of infections resulting from each node. These actual infection numbers could be very important in many applications.
  2. While the existing inference measures do a good job, they do not actually directly examine the mechanics of disease spreading. As such, there is still room for improvement. As an example of potential improvement areas: none of the above-mentioned measures change their relative inference with the rate of infection β.
So, we sat down and thought hard about the local network properties that best relate to the mechanics of disease spreading. From our perspective, disease spreads on a network in the manner of a walk. The disease can only reach node B from node A on a walk from A to B, where every node on that walk is also infected. Our basic idea is that the count of the number of walks from the initially infected node to other susceptible nodes (an approach known as path counting) should be a local network structural property that gives good insight into disease spreading.

We developed the idea further, working out the mathematics to turn these path counts into estimates of infection numbers, as a function of spreading rate β. Interestingly, different types of walks are involved for different disease spreading models; e.g. for SIR spreading one is only interested in self-avoiding walks (since no node can be infected twice), whereas for SIS (susceptible/infected/susceptible) spreading one is interested in any type of walk. Our estimates are not perfect, and we identify where and how known errors will occur. However, the estimates have several very useful properties compared to other approaches:
  1. Our technique provides estimates of actual numbers of infections from a given initially-infected node, which is more useful than inferred relative spreading efficiency alone.
  2. Importantly, testing against simulations on social network structures reveals that the relative spreading efficiencies inferred by our technique are more accurate than those of the aforementioned previously published techniques. This is because our technique directly considers the mechanics of disease spreading.
  3. And our technique has comparable computationally efficiency with the aforementioned inference techniques - taking ~3 seconds for the network mentioned above whose full simulations took 50 minutes. (There is a trade-off in our technique between computational efficiency and higher accuracy, by considering long path lengths, however the better accuracy referred to above is achievable at the path lengths computable in 3 seconds.)
As such, we show that path counts provide the following unique combination of features: they are the most relevant local network structural feature to infer relative disease spreading efficiency, provide estimates of actual infection numbers, and are computationally efficient.

Comments/suggestions welcome, of course ...

Monday, December 5, 2011

10th International Conference on Cellular Automata for Research and Industry (ACRI 2011)

The first call for papers is out for the 10th International Conference on Cellular Automata for Research and Industry (ACRI 2012), to be held on Santorini Island, Greece, September 24-27, 2012.

The main website is at http://acri2012.duth.gr/
Important dates at http://acri2012.duth.gr/dates.html - submissions are due March 19, 2012.
Other important information includes that the proceedings will be published in Springer LNCS.

This year I am part of the program committee, which should be quite interesting. I've come across many papers from this conference series, including "Local Information in One-Dimensional Cellular Automata" which influenced my own work on filtering CAs. I'm looking forward to going, and hope to see you there.

Friday, October 7, 2011

Topical Issue on Guided Self-Organization

Following the success of the third and fourth Guided Self-Organization workshops (this year and last), there is a call for papers out for a topical issue on Guided Self-Organization in Advances in Complex Systems next year.

Important dates are:
  • expression of interest (tentative title and list of authors) to guest editors : 4. November 2011
  • submission to ACS: 31 January 2012
  • notification: 30 April 2012
  • camera-ready papers: 31 May 2012

Full details of the CFP are at http://informatics.indiana.edu/larryy/gso4/cfp/index.html and an excerpt is below:

The goal of Guided Self-Organization (GSO) research is to leverage the strengths of self-organization while still being able to direct the outcome of the self-organizing process. The ACS Topical Issue on Guided Self-Organization aims to condense the current state-of-art in guided self-organizing systems, including, but not limited to information- and graph-theoretic foundations of GSO and the information dynamics of cognitive systems.

A number of attempts have been made to formalize aspects of GSO within information theory and dynamical systems: empowerment, information-driven evolution, robust overdesign, reinforcement-driven homeokinesis, predictive information-based homeokinesis, interactive learning, etc. However, the lack of a broadly applicable mathematical framework across multiple scales and contexts leaves GSO methodology incomplete. Devising such a framework and identifying common principles of guidance are the main themes of GSO.

Papers need not be regarding work presented at the workshops, new work is also solicited. Good luck with your submissions!

Monday, July 18, 2011

GSO 4

A quick note to promote the Fourth International Workshop on Guided Self-Organization (GSO 4):

The goal of Guided Self-Organization (GSO) is to leverage the strengths of self-organization while still being able to direct the outcome of the self-organizing process. The GSO-2011 workshop will bring together invited experts and researchers in self-organizing systems, with particular emphasis on the information- and graph-theoretic foundations of GSO and the information dynamics of cognitive systems.
...
The following topics are of special interest: information-theoretic measures of complexity, graph-theoretic metrics of networks, information-driven self-organization (IDSO), applications of GSO to systems biology, computational neuroscience, cooperative and modular robotics, sensor networks, and cognitive modeling.

Some good friends of mine have been behind this series (this year, Daniel Polani, Larry Yaeger, and my old supervisor Mikhail Prokopenko). The series started at our lab in Sydney 3 years ago, and it's pleasing to see that it has really got some momentum behind it now.

Unfortunately I have to miss it this year, but if this sounds like your field then I recommend that you go, as this will be an excellent meeting.

Abstracts are due by July 31, the workshop itself is on Sept 8-10 2011 in Hertfordshire, UK.

Wednesday, July 13, 2011

Carbon tax shenanigans

It's been a little strange watching all the debate at home about the incoming carbon tax. The commentators on the right are getting so frothy-mouthed and vicious about the whole thing. Hardly a surprise I suppose.

The weirdest thing is the loss of perspective. I think it's best summarised in this blog post (tip to Elliot):
http://www.heathenscripture.com/you-shut-your-goddamn-carbon-taxin-mouth/

It's a great shot of perspective there. And I have to agree - if you can't afford $10 a week out of your $100k+ income for something for your kids' futures like this, my heart bleeds. Really.

I also wanted to share something I saw on the BBC news this morning. After a story on the impending (real) Italian financial crisis, they reported that consumer confidence in Australia had reached a low point, noting with unhidden incredulity that this was despite (and I paraphrase) "near zero unemployment, strong growth and record standard of living" but seemed "related to fears about a carbon tax". It's difficult not to feel embarrassed about that.

Thursday, April 21, 2011

I must start writing again ...

Well it's been a while, and a lot has happened since I last wrote.

In the last 18 months or so, I've submitted my PhD thesis, worked some more hours in my software engineering job, wrote up a few papers, graduated, moved to Leipzig, Germany and started as a postdoc at the Max Planck Institute for Mathematics in the Sciences.

Life hasn't exactly settled down, but I am planning on writing about all of the above in the near future ...
 
;