Our Vision

We are a team of scientists and engineers working together to solve key challenges that the world is facing. We focus on using machine learning to optimize complex decision making and reduce inefficiencies.

What We Do

At present we are successfully deploying our machine learning techniques to optimize the electricity grid by improving advance planning of electricity production and distribution, resulting in decreased economic waste and environmental damage.

Our Impact

Reduced CO2 emissions and pollution.
Improved reliability of the grid.
Less waste and increased economic efficiency.

More

Research Areas

Energy Systems
Electricity cannot be economically stored at utility scales. Supply and demand must be balanced at all times, and the structure of the transmission grid massive amounts of inefficiency. In order to deal with these issues, and to ensure reliable access to power, the global standard is to centralize control under Independent System Operators, who coordinate the grid for electric utilities. The efficiency of the electricity grid is also of fundamental importance for achieving lower carbon emissions, and reducing the impact of coal pollution on human health. Understanding all aspects of the electrical grid and their properties and complexities is an area of our core focus at present.
Machine Learning
Invenia Lab’s machine learning is focused on systems with a fundamental importance to everyday life, but which are not dealt with efficiently. Our central interest is in optimizing complex decision-making and resource usage under uncertainty. In particular, the electricity grid offers data with unique properties, including many time series with complex structures, and operations that change rapidly. While our focus is on practical problems, we are also actively working on more fundamental research with a focus on AI, time series forecasting and decision-making.
Complex Systems
Complex Systems is a broad area of research focused on studying systems made of a large number of interacting components and the emergence of complex collective behaviors. Social systems, the brain, and electricity grids are examples. A related area of interest is Complex Adaptive Systems, referring to systems reorganizing themselves to solve complex problems. Neural Networks and Memristors are two such examples. We are focused on the practical aspects in the application of these tools, but also advancing the fields from a theoretical perspective.
Finance
Our interest in finance tools and techniques stems from our work in electricity grids, which provide unique challenges with transmission due to the physical properties of electricity. We are studying risk, the processes that improve the efficiency of the grid and the consequences of regulatory changes. There are also many interesting connections between finance, statistical mechanics and complex systems to explore.

Our Team / Researchers

We come from many backgrounds including machine learning, mathematics, physics, computer science, engineering and economics. We are all interested in problems that have a substantial impact on the world, specifically complex systems that involve economic and environmental efficiency.
Chief Executive Officer / Co-Founder
Matt Hudson
Matt co-founded Invenia, and has been CEO from the start. He started Invenia while at Microsoft, after majoring in political science and economics with additional studies in computer science and engineering. He has developed a deep knowledge of the electrical grid, complex networks, and machine learning.
Chief Technology Officer / Co-Founder
Christian Steinruecken
Christian completed his PhD under the supervision of Prof Sir David MacKay at the University of Cambridge (UK) and is a specialist in machine learning. He has led engineering projects in artificial intelligence, data compression, and probabilistic programming. Christian believes that building intelligent technology is our best hope for making the world a better place.
Chief People Operations Officer / Co-Founder
Oksana Koval
Oksana is a co-founder of Invenia and is currently the Chief People Operations Officer, overseeing operations in Canada and the UK. She attended the University of Manitoba where she studied Anthropology as a post-graduate. In her spare time, she also pursues research interests in machine learning and archaeology. In the past, she has excavated a 3,000-year-old settlement in Crete, Greece, and for her Master’s thesis, she applied machine learning to identify the ceramic manufacturing techniques of ancient potters.
Managing Director Invenia Labs/ Chief Science Officer / Co-Founder
Cozmin Ududec
Cozmin is a co-founder of Invenia and now also the Managing Director and Chief Science Officer of Invenia Labs in Cambridge. He received his PhD in the foundations of quantum theory from the University of Waterloo and is still puzzling over the quantum world in his spare time.
Scientific Advisor / Co-founder
David Duvenaud
David is a co-founder of Invenia and an assistant professor in computer science and statistics at the University of Toronto. He received his PhD in machine learning from Cambridge University. Before Invenia, he also worked at Google Research, the Max Planck Institute for Intelligent Systems, and the Harvard Intelligent Probabilistic Systems group.
Researcher
Alex Robson
Alex has a PhD in Biophysics from Oxford University, where he worked on applying machine learning techniques to model biological data. Since then, he's worked on numerous applications of ML, including one for a startup in the energy sector and another for risk models in fintech. In his spare time, Alex can often be found playing board games or occasionally hacking around on personal ML projects.
Researcher
Andrew Rosemberg
Andrew received a BSc in control engineering from PUC-RIO and a BSc in general engineering from École Centrale de Marseille. He also holds a master's in Electrical Engineering with an emphasis on Operation Research, focusing on Power Systems and Energy markets. Some of his previous projects revolve around energy economic dispatch analysis and simulation, financial data classification and portfolio optimization. His main interests are optimization, decisions under uncertainty and machine learning.
Researcher
Anton Isopoussu
Most recently, Anton has been interested in unsupervised learning using ideas from optimal transport. Before getting into machine learning, he studied mathematics, physics and computer science in Helsinki and then went on to complete a PhD in algebraic geometry in Cambridge.
Developer
Arnaud Henry
Arnaud graduated from the University of Edinburgh with an MSc in Artificial Intelligence in 2012. Since then, he's been working at various companies as a software engineer, notably in the music streaming industry and in the emerging space of autonomous vehicles. In his spare time, he enjoys travelling and tinkering with pet projects.
Researcher
Astrid Dahl
After achieving a Masters in Economics and Econometrics at the University of Sydney, Astrid completed her PhD in machine learning at the University of New South Wales. She has previously worked as a professional econometrician in the energy and financial sectors but now, as a researcher for Invenia, she finds ways of improving the computational efficiency of multi-task Gaussian process models for solar power forecasting. Her main research interests are scalable nonparametric methods for spatiotemporal modeling, structured prediction and grid integration of distributed generation.
Senior Researcher
Bella Wu
Bella achieved her PhD in engineering at the University of Cambridge, where she developed advanced signal processing techniques, including many based on Bayesian inference, for magnetic resonance applications. Before joining Invenia, Bella worked at a startup on building energy models that provide forecast and analysis for use in hedging, trading, and investments. She is interested in combining mathematical modelling and machine learning with fundamental theories in fields such as engineering and economics to gain unique insights into complicated systems that have a significant social impact.
Research Engineer
Ben Cottier
Ben completed an MSc Artificial Intelligence at The University of Edinburgh in 2020. He likes to take a closer look at machine learning research and build software to make it better. When he’s not working, you might find him hiking or pondering the future of AI.
Research Engineer
Branwen Snelling
Branwen did her PhD in Geophysics at Imperial College London, where she used an array of computational fluid dynamics models to research landslide-tsunami hazards. Along the way she explored uncertainty quantification and machine learning methods for natural hazard assessment. She is interested in building and using modelling tools to better understand the natural world and other complex systems.
People Operations Associate
Caolán Jennings
Caolán has been a Cambridge local since 2007. With an academic background in philosophy and law, he is always ready for a friendly chat. Outside of work you can normally find him enjoying a good book or playing music with friends.
Senior Researcher
Chris Davis
Chris was formerly an Assistant Professor in Energy Informatics and Modelling at the University of Groningen. He received his PhD at the Delft University of Technology, and his work covers topics related to Energy, Sustainability, Linked Data, Machine Learning, Data Visualisation, and Agent-Based Modelling. Here are a few papers published by Chris: 1. Secondary Resources in the Bio-Based Economy: A Computer Assisted Survey of Value Pathways in Academic Literature 2. Electric vehicle charging in China’s power system: Energy, economic and environmental trade-offs and policy implications 3. The state of the states: Data-driven analysis of the US Clean Power Plan For the rest of Chris' published work, please refer to his Google Scholar profile.
Advisor
Doyne Farmer
Alongside his work with Invenia as a Research Advisor, Doyne is also a Professor in the Mathematical Institute at the University of Oxford and an External Professor at the Santa Fe Institute. His current research is in economics, including agent-based modeling, financial instability, and technological progress. He was a founder of Prediction Company, a quantitative automated trading firm that was sold to the United Bank of Switzerland in 2006. His past research includes complex systems, dynamical systems theory, time series analysis, and theoretical biology.
Researcher
Eric Perim Martins
Eric received his PhD in Physics from the University of Campinas, where he worked on Nanotechnology problems using Computational Physical-Chemistry techniques. He then moved to Duke University where he looked into High-Throughput Materials Science methods before joining Invenia.
Research Advisor
Francesco Caravelli
Francesco's research focuses on statistical physics as well as complex systems, in particular, complex networks, memristive circuits, econophysics, and agent-based modelling. He is a theoretical physicist, interested in quantum and classical systems and the application of techniques of statistical physics and complexity to other disciplines such as economics, engineering, and finance. He has been a Senior Researcher at Invenia Labs in Cambridge and a researcher at the London Institute for Mathematical Sciences, before moving as an Oppenheimer Fellow to Los Alamos National Laboratory.
Research Engineer
Glenn Moynihan
Glenn Moynihan is native of county Cork in Ireland but upped sticks to study Theoretical Physics at Trinity College Dublin where he received his Bachelor's in 2013 and his PhD in 2018. His research focused on improving the accuracy and scope of linear-scaling density-functional theory applied to large-scale calculations of materials exhibiting strongly-correlated electrons.
Junior Researcher
Ian Goddard
Ian is a recent Master's graduate in data science from the University of Edinburgh where he has previously completed a Bachelor's degree in Physics. His main area of interest is how we can use data science and machine learning to help in the transition of the energy sector to a more renewable mix. His interests in machine learning are broad, with a particular interest in probabilistic modelling, Bayesian learning, and graph theory.
Developer
James Hamblin
James graduated with a BSc in Mathematics from Loughborough University. Before working at Invenia, he worked as a DevOps engineer for a startup developing artificial intelligence software for the legal profession.
Senior Researcher
James Requeima
James is a senior researcher at Invenia and a PhD student studying machine learning at the University of Cambridge in the Computational and Biological Learning Lab, under the supervision of Dr. Richard Turner. His interests include Bayesian optimisation, learning, approximate inference methods, and deep generative models. He previously completed a master’s in machine learning, speech, and language technology at the University of Cambridge under the supervision of Dr. Zoubin Ghahramani and a master’s of mathematics from the McGill University under Daniel Wise.
People Operations Manager
João Moraes
After completing a law degree Joao went into business through a variety of roles, ultimately completing an MBA at the University of Cambridge. His previous background includes managing all aspects of a restaurant chain, brand strategy consultancy, and leadership development.
Senior Researcher
Joshua Knowles
Josh is an honorary professor at the Alliance Manchester Business School (University of Manchester), and an honorary fellow at the School of Computer Science, University of Birmingham. He is interested in developing robust algorithms for optimization, optimal control and decision making, particularly for problems involving multiple objectives, uncertainty, dynamical aspects (including interruptions), and human interaction. He is also interested in the ethical use of optimization and machine learning.
Researcher
Letif Mones
Letif received his PhD in computational chemistry from ELTE University, Hungary, where he worked on the methodological improvement of hybrid QM/MM approaches and free energy computations for complex systems. At the University of Cambridge and later at the University of Warwick, he developed an efficient sampling technique in combination with Gaussian process regression. In addition to this, he also introduced a protocol for constructing high dimensional quantum surfaces of organic molecules using machine learning and developed universal preconditioners to enhance the performance of optimisation techniques.
Research Engineer
Lyndon White
Lyndon is passionate about building the tools to do research better. His current specific interests are around tooling for machine learning libraries, in particular automatic differentiation. Lyndon completed his PhD on Natural Language Processing via Machine Learning (Titled “On the surprising capacity of linear combinations of embeddings”) at the University of Western Australia in 2018. He has been programming Julia since 2014, and is currently a maintainer of, and contributor to, some unreasonable number of packages.
Facilities Coordinator
Magda Karavatou
Magda was born in Thessaloniki, Greece, and moved to Cambridge in 2019. She has previously studied Economic Science at the University of Macedonia and has received an IT skills certificate from the University of Cambridge.
Researcher
Mahdi Jamei
Mahdi Jamei received a BSc degree in Science and Technology in 2013 and an MSc in Electrical and Computer Engineering from Florida International University in 2014. He then went on to achieve a Ph.D. in Electrical and Computer Engineering from Arizona State University in 2018. His research interests lie primarily in developing computational analytic tools for power systems employing mathematical and signal processing techniques. He has been studying the security challenges of interdependent critical infrastructures of power, cyber and gas networks over the past few years.
Data Scientist
Max Lensvelt
Max has worked in power markets and renewable energy within the UK, Europe, and the United States for almost a decade. His experience encompasses analytical roles in private equity, utilities, and industry. Most recently, he has worked as a Data Scientist for the developer of the UK's first virtual power plant. He also holds a BSc in Physics and an MSc in Data Science.
Research Engineer
Miha Zgubič
Miha, originally from Slovenia, is a theoretical physicist by training and holds an MSci degree from Imperial College London. After completing his Masters, he moved to the countryside to pursue a PhD at the University of Oxford where he analysed the data from the Large Hadron Collider at CERN searching for a rare decay of the Higgs boson. He likes python, boosted decision trees, and Federer's one-handed backhand.
Research Engineer
Nick Robinson
Nick recently completed a master's in AI at Edinburgh University, having previously studied analytic philosophy at Cambridge. In between, he worked at ASI building machine learning models for all sorts of different companies.
Intern
Pavel Berkovitch
Pavel is a researcher, whose interests span time-series forecasting, dynamical systems, approximate Bayesian inference and reinforcement learning. Pavel joined Invenia whilst completing his MSc in Computational Statistics and Machine Learning at University College London under the supervision of Prof John Shawe-Taylor. Before pursuing graduate studies, Pavel spent two years at Morgan Stanley devising quantitative risk models for fixed-income financial products, after obtaining his BA in Computer Science from the University of Cambridge. Outside of work, Pavel is passionate about basketball, world history and financial markets.
Researcher
Raphael Saavedra
Raphael received his MSc and BSc degrees in Electrical Engineering with an emphasis in Operations Research from the Pontifical Catholic University of Rio de Janeiro. He previously worked in projects with major electricity distribution companies with the goal of forecasting demands and optimizing contracts. He is also a Julia programmer and contributes to open- source projects. His main interests are optimization, time series models, and power system operation.
Talent Specialist
Robbie Smith
Robbie graduated from the University of Southampton with a Bachelor’s degree in Music, where he specialised in composition. Since then, he has worked in technical recruitment and a variety of administrative roles. Robbie loves learning about new technologies and computing. He also enjoys writing music and comedy in his spare time.
Chief Analytics Officer
Sam Hancock
Sam is a strategic analytical leader who has worked at companies ranging from 5-person startups to $100B+ multinationals. Most recently he guided Waymo’s Engineering Operations organization, the team that supports software development for Alphabet’s self-driving car project. At Invenia he is responsible for analytically connecting the company’s activities to its overarching objectives. Outside of work Sam is a semi-professional drummer, performing on the West End multiple times, and competes in triathlons.
Head of Architecture and Operations
Sascha McDonald
Sascha is a senior executive with a track record of developing and implementing strategies that drive revenue and service delivery within start-up and blue-chip businesses. His expertise includes designing enterprise architecture and delivering operational capability across people, processes and technology. In addition to this, he has masses of international experience in leading business development activity, contract negotiations to generate multi-million-pound revenue streams, and leading multiple teams within both matrix and direct management environments. His previous work has also included managing relationships at the CxO level with clients, suppliers, and strategic partners.
Researcher
Sean Lovett
Sean received his PhD in computational physics from the University of Cambridge, where he worked on adaptive meshing methods in computational fluid mechanics. Since then, he has worked as a research scientist in R&D for the oil and gas industry, where his research interests included complex fluids, reduced-order models, and the application of statistical modelling to physical systems. He has also been involved in several academic collaborations and physics outreach projects.
Research Intern
Thomas Falconer
Thomas is a graduate student in Energy Systems and Data Analytics at University College London and will be carrying out his research thesis in collaboration with Invenia Labs. He previously completed his undergraduate studies at Heriot-Watt University in Chemical Engineering, with a primary focus of biochemical process design. His research interests lie in the application of machine learning and data analytics to facilitate climate change mitigation and enhance the sustainability of energy systems, with particular passions for grid decarbonisation and power systems optimisation.
Developer
Timothy Levins
Timothy was born in Malaysia and has recently graduated from the University of Manitoba with a bachelor’s of science degree in Computer Science. His work at Invenia started as part of his first internship as a junior developer, and he spent most of his time working with the data feeds team to build Invenia’s data gathering framework. In his spare time, he loves to explore new places.
Researcher
Wessel Bruinsma
Wessel is currently a PhD student at the University of Cambridge. He holds an MPhil in Machine Learning and Machine Intelligence also from the University of Cambridge. At Invenia, Wessel researches machine learning and investigates applications thereof. His main research interests include probabilistic modelling, Bayesian nonparametrics, approximate inference, and signal processing.
Research Associate
Will Tebbutt
Will is currently a PhD student in the Machine Learning Group at the University of Cambridge. He will be undertaking a research internship over the summer of 2020 looking at probabilistic models for time series.  When not working, he can be found playing the guitar or listening to people play it well.
Advisor
Zoubin Ghahramani
Zoubin works with Invenia as an advisor. He is also a professor of Information Engineering at the University of Cambridge, where he leads the Machine Learning Group consisting of about 30 researchers, and the Cambridge Liaison Director of the Alan Turing Institute, the UK's national institute for Data Science. His academic career includes concurrent appointments as one of the founding members of the Gatsby Computational Neuroscience Unit in London, and as a faculty member of CMU's Machine Learning Department for over ten years. His current research interests include statistical machine learning, Bayesian nonparametrics, scalable inference, probabilistic programming, and building an automatic statistician. He has published over 250 papers, receiving over 30,000 citations (an h-index of 74).

Papers

Explore some of the papers published by people on the Invenia Labs team.
All
https://wordpress.invenia.ca/wp-content/uploads/Untitled-2.png
Reduction of the Optimal Power Flow Problem through Meta-Optimization
We introduce a method for solving Optimal Power Flow (OPF) using meta-optimization, which can substantially reduce solution times. A pre-trained classifier that predicts the binding constraints of the system is used to generate an initial reduced OPF problem, defined by removing the predicted non-binding constraints. Through an iterative procedure, this initial set of constraints is then ex- tended by those constraints that are violated but not represented in the reduced OPF, guaranteeing an optimal solution of the original OPF problem with the full set of constraints. The classifier is trained using a meta-loss objective, defined by the computational cost of the series of reduced OPF problems.
      Poster
https://www.climatechange.ai/CameraReadySubmissions2-119/44/CameraReadySubmission/NeurIPS2019_workshop.pdf
Alex Robson, Mahdi Jamei, Cozmin Ududec, and Letif Mones
https://wordpress.invenia.ca/wp-content/uploads/paper-image.png
GP-ALPS: Automatic Latent Process Selection for Multi-Output Gaussian Process Models
A simple and widely adopted approach to extend Gaussian processes (GPs) to multiple outputs is to model each output as a linear combination of a collection of shared, unobserved latent GPs. An issue with this approach is choosing the number of latent processes and their kernels. These choices are typically done manually, which can be time consuming and prone to human biases. We propose Gaussian Process Automatic Latent Process Selection (GP-ALPS), which automatically chooses the latent processes by turning off those that do not meaningfully contribute to explaining the data. We develop a variational inference scheme, assess the quality of the variational posterior by comparing it against the gold standard MCMC, and demonstrate the suitability of GP-ALPS in a set of preliminary expAABI_Poster
https://arxiv.org/abs/1911.01929
Pavel Berkovich, Eric Perim, Wessel Bruinsma
https://wordpress.invenia.ca/wp-content/uploads/image.png
Learning an Optimally Reduced Formulation of OPF through Meta-optimization
https://arxiv.org/abs/1911.06784
Alex Robson, Mahdi Jamei, Cozmin Ududec, and Letif Mones
https://wordpress.invenia.ca/wp-content/uploads/site_image.png
Meta-Optimization of Optimal Power Flow
The planning and operation of electricity grids is carried out by solving various forms of con- strained optimization problems. With the increasing variability of system conditions due to the integration of renewable and other distributed energy resources, such optimization problems are growing in complexity and need to be repeated daily, often limited to a 5 minute solve-time. To address this, we propose a meta-optimizer that is used to initialize interior-point solvers. This can significantly reduce the number of iterations to converge to optimality. Poster
https://www.climatechange.ai/CameraReady/43/CameraReadySubmission/icml_invenia_cameraready.pdf
Mahdi Jamei, Letif Mones, Alex Robson, Lyndon White, James Requeima, Cozmin Ududec
https://wordpress.invenia.ca/wp-content/uploads/francesco_paper_Image.png
Memristive networks: From graph theory to statistical physics
This paper is an introduction to a very specific toy model of memristive networks, for which an exact differential equation for the internal memory which contains the Kirchhoff laws is known. In particular, we highlight how the circuit topology enters the dynamics via an analysis of directed graph. We try to highlight in particular the connection between the asymptotic states of memristors and the Ising model, and the relation to the dynamics and statics of disordered systems.
http://iopscience.iop.org/article/10.1209/0295-5075/125/10001/pdf
A. Zegarac and F. Caravelli
https://wordpress.invenia.ca/wp-content/uploads/chris_davis_paper_avatar.png
Business models design space for electricity storage systems: Case study of the Netherlands
Because of weather uncertainty and dynamics, power generation from some renewable energy technologies is variable. Electricity storage is recognized as a solution to better integrate variable renewable generation into the electricity system. Despite considerable growth in the research on the electricity storage, implementation of electricity storage systems (ESS) is globally negligible because of technical, institutional, and business model challenges. We use literature review and data analysis to provide a conceptual framework and a design space for ESS business models in the case of Dutch electricity sector by taking technological, institutional, and business model considerations into account. We provide a map of single-application business models for ESS in the Netherlands which can be used as a basis for making ESS application portfolios and evaluating ESS business models in other parts of the world as well. Furthermore, this research can be used to inform models that explore the evolution of ESS.
https://www.sciencedirect.com/science/article/pii/S2352152X18301609?viaihub
S.A.R. Mir Mohammadi Kooshknow, C.B. Davis
https://wordpress.invenia.ca/wp-content/uploads/Screen-Shot-2018-02-28-at-09.22.22.png
The Gaussian Process Autoregressive Regression Model (GPAR)
Multi-output regression models must exploit dependencies between outputs to maximise predictive performance. The application of Gaussian processes (GPs) to this setting typically yields models that are computationally demanding and have limited representational power. We present the Gaussian Process Autoregressive Regression (GPAR) model, a scalable multi-output GP model that is able to capture nonlinear, possibly input-varying, dependencies between outputs in a simple and tractable way: the product rule is used to decompose the joint distribution over the outputs into a set of conditionals, each of which is modelled by a standard GP. GPAR’s efficacy is demonstrated on a variety of synthetic and real-world problems, outperforming existing GP models and achieving state-of-the-art performance on the tasks with existing benchmarks.
http://wordpress.invenia.ca/wp-content/uploads/The-Gaussian-Process-Autoregressive-Regression-Model-GPAR.pdf
https://wordpress.invenia.ca/wp-content/uploads/Screen-Shot-2018-02-28-at-08.34.11.png
Learning Causally-Generated Stationary Time Series
We present the Causal Gaussian Process Convolution Model (CGPCM), a doubly nonparametric model for causal, spectrally complex dynamical phenomena. The CGPCM is a generative model in which white noise is passed through a causal, nonparametric-window moving-average filter, a construction that we show to be equivalent to a Gaussian process with a nonparametric kernel that is biased towards causally-generated signals. We develop enhanced variational inference and learning schemes for the CGPCM and its previous acausal variant, the GPCM (Tobar et al., 2015b), that significantly improve statistical accuracy. These modelling and inferential contributions are demonstrated on a range of synthetic and real-world signals.
http://wordpress.invenia.ca/wp-content/uploads/Learning-Causally-Generated-Stationary-Time-Series.pdf
Wessel Bruinsma, Richard E. Turner
https://wordpress.invenia.ca/wp-content/uploads/Correlations-and-Clustering-in-Wholesale-Electricity-Markets-thumbnail.jpg
Correlations and Clustering in Wholesale Electricity Markets
We study the structure of locational marginal prices in day-ahead and real-time wholesale electricity markets. In particular, we consider the case of two North American markets and show that the price correlations contain information on the locational structure of the grid. We study various clustering methods and introduce a type of correlation function based on event synchronization for spiky time series, and another based on string correlations of location names provided by the markets. This allows us to reconstruct aspects of the locational structure of the grid.
http://wordpress.invenia.ca/wp-content/uploads/Correlations-and-Clustering-in-Wholesale-Electricity-Markets.pdf
Tianyu Cui, Francesco Caravelli, Cozmin Ududec
https://wordpress.invenia.ca/wp-content/uploads/edges.png
The mise en scène of memristive networks: effective memory, dynamics and learning
We discuss the properties of the dynamics of purely memristive circuits. In particular, we show that the amount of memory in a memristive circuit is constrained by the conservation laws of the circuit, and that the dynamics preserves the symmetry by means of a projection on this subspace. We obtain these results both for current and voltage controlled linear memristors. Moreover, we discuss the symmetries of the dynamics which are due to the circuit cohomology, and study the weak and strong non-linear regimes.
https://arxiv.org/abs/1611.02104
Francesco Caravelli
https://wordpress.invenia.ca/wp-content/uploads/memristors.png
The complex dynamics of memristive circuits: analytical results and universal slow relaxation
Networks with memristive elements (resistors with memory) are being explored for a variety of applications ranging from unconventional computing to models of the brain. However, analytical results that highlight the role of the graph connectivity on the memory dynamics are still a few, thus limiting our understanding of these important dynamical systems. In this paper, we derive an exact matrix equation of motion that takes into account all the network constraints of a purely memristive circuit, and we employ it to derive analytical results regarding its relaxation properties. We are able to describe the memory evolution in terms of orthogonal projection operators onto the subspace of fundamental loop space of the underlying circuit. This orthogonal projection explicitly reveals the coupling between the spatial and temporal sectors of the memristive circuits and compactly describes the circuit topology. For the case of disordered graphs, we are able to explain the emergence of a power law relaxation as a superposition of exponential relaxation times with a broad range of scales using random matrices. This power law is also {\it universal}, namely independent of the topology of the underlying graph but dependent only on the density of loops. In the case of circuits subject to alternating voltage instead, we are able to obtain an approximate solution of the dynamics, which is tested against a specific network topology. These result suggest a much richer dynamics of memristive networks than previously considered.
https://arxiv.org/abs/1608.08651
Francesco Caravelli, Fabio Lorenzo Traversa, Massimiliano Di Ventra
https://wordpress.invenia.ca/wp-content/uploads/2016/08/memr.png
Trajectories entropy in dynamical graphs with memory
In this paper we investigate the application of non-local graph entropy to evolving and dynamical graphs. The measure is based upon the notion of Markov diffusion on a graph, and relies on the entropy applied to trajectories originating at a specific node. In particular, we study the model of reinforcement-decay graph dynamics, which leads to scale free graphs. We find that the node entropy characterizes the structure of the network in the two parameter phase-space describing the dynamical evolution of the weighted graph. We then apply an adapted version of the entropy measure to purely memristive circuits. We provide evidence that meanwhile in the case of DC voltage the entropy based on the forward probability is enough to characterize the graph properties, in the case of AC voltage generators one needs to consider both forward and backward based transition probabilities. We provide also evidence that the entropy highlights the self-organizing properties of memristive circuits, which re-organizes itself to satisfy the symmetries of the underlying graph.
http://arxiv.org/abs/1511.07135
Francesco Caravelli
https://wordpress.invenia.ca/wp-content/uploads/2016/08/conformity-driven.png
Conformity Driven Agents Support Ordered Phases in the Spatial Public Goods Game
We investigate the spatial Public Goods Game in the presence of conformity-driven agents on a bi-dimensional lattice with periodic boundary conditions. The present setting usually considers fitness-driven agents, i.e., agents that tend to imitate the strategy of their fittest neighbors. Here, fitness is a general property usually adopted to quantify the extent to which individuals are able to succeed, or at least to survive, in a competitive environment. However, when social systems are considered, the evolution of a population might be affected also by social behaviors as conformity, stubbornness, altruism, and selfishness. Although the term evolution can assume different meanings depending on the considered domain, here it corresponds to the set of processes that lead a system towards an equilibrium or a steady-state. In doing so, we use two types of strategy update rules: fitness-driven and conformity-driven. We map fitness to the agents' payoff so that richer agents are those most imitated by fitness-driven agents, while conformity-driven agents tend to imitate the strategy assumed by the majority of their neighbors. Numerical simulations aim to identify critical phenomena, on varying the amount of the relative density of conformity-driven agents in the population, and to study the nature of related equilibria. Remarkably, we find that conformity fosters ordered phases and may also lead to bistable behaviors.
http://arxiv.org/abs/1602.01808
Marco Alberto Javarone, Alberto Antonioni, Francesco Caravelli
https://wordpress.invenia.ca/wp-content/uploads/Optimal-growth-paper-logo.png
Optimal growth trajectories with finite carrying capacity
We investigate the spatial Public Goods Game in the presence of conformity-driven agents on a bi-dimensional lattice with periodic boundary conditions. The present setting usually considers fitness-driven agents, i.e., agents that tend to imitate the strategy of their fittest neighbors. Here, fitness is a general property usually adopted to quantify the extent to which individuals are able to succeed, or at least to survive, in a competitive environment. However, when social systems are considered, the evolution of a population might be affected also by social behaviors as conformity, stubbornness, altruism, and selfishness. Although the term evolution can assume different meanings depending on the considered domain, here it corresponds to the set of processes that lead a system towards an equilibrium or a steady-state. In doing so, we use two types of strategy update rules: fitness-driven and conformity-driven. We map fitness to the agents' payoff so that richer agents are those most imitated by fitness-driven agents, while conformity-driven agents tend to imitate the strategy assumed by the majority of their neighbors. Numerical simulations aim to identify critical phenomena, on varying the amount of the relative density of conformity-driven agents in the population, and to study the nature of related equilibria. Remarkably, we find that conformity fosters ordered phases and may also lead to bistable behaviors.
http://arxiv.org/abs/1602.01808
Marco Alberto Javarone, Alberto Antonioni, Francesco Caravelli
https://wordpress.invenia.ca/wp-content/uploads/2016/06/Neurogensis-Paradoxically.png
Neurogenesis Paradoxically Decreases Both Pattern Separation and Memory Interference
The hippocampus has been the focus of memory research for decades. While the functional role of this structure is not fully understood, it is widely recognized as being vital for rapid yet accurate encoding and retrieval of associative memories. Since the discovery of adult hippocampal neurogenesis in the dentate gyrus by Altman and Das in the 1960's, many theories and models have been put forward to explain the functional role it plays in learning and memory. These models postulate different ways in which new neurons are introduced into the dentate gyrus and their functional importance for learning and memory. Few if any previous models have incorporated the unique properties of young adult-born dentate granule cells and the developmental trajectory. In this paper, we propose a novel computational model of the dentate gyrus that incorporates the developmental trajectory of the adult-born dentate granule cells, including changes in synaptic plasticity, connectivity, excitability and lateral inhibition, using a modified version of the Restricted Boltzmann machine. Our results show superior performance on memory reconstruction tasks for both recent and distally learned items, when the unique characteristics of young dentate granule cells are taken into account. Even though the hyperexcitability of the young neurons generates more overlapping neural codes, reducing pattern separation, the unique properties of the young neurons nonetheless contribute to reducing retroactive and proactive interference, at both short and long time scales. The sparse connectivity is particularly important for generating distinct memory traces for highly overlapping patterns that are learned within the same context.
http://journal.frontiersin.org/article/10.3389/fnsys.2015.00136/full
Becker, Finnegan
https://wordpress.invenia.ca/wp-content/uploads/2016/06/Correlation-Structure.png
Correlation Structure of Spiky Financial Data: The Case of Congestion in Day-Ahead Energy Markets
I study the correlation structure and argue that these should be ltered. I propose the use of di erent correlation measures other than Pearson, in particular a modi cation of Event Synchronization adapted to negative values or a ltered correlation matrix.
https://wordpress.invenia.ca/wp-content/uploads/Internal2_Caravelli.pdf
Caravelli
https://wordpress.invenia.ca/wp-content/uploads/2016/06/integrated-expontential.png
On Moments of the Integrated Exponential Brownian Motion
We present new exact expressions for a class of moments for the geometric Brownian motion, in terms of determinants, obtained using a recurrence relation and combinatorial arguments for the case of a Ito’s Wiener process. We then apply the obtained exact formulas to computing averages of the solution of the logistic stochastic differential equation via a series expansion, and compare the results to the solution obtained via Monte Carlo.
http://arxiv.org/abs/1509.05980
Caravelli, Mansur, Severini, Sindoni
https://wordpress.invenia.ca/wp-content/uploads/2016/06/Bounds-on-Transient.png
Bounds on Transient Instability For Complex Ecosystems
Stability is a desirable property of complex ecosystems. If a community of interacting species is at a stable equilibrium point then it is able to withstand small perturbations without any adverse effect. In ecology, the Jacobian matrix evalufated at an equilibrium point is known as the community matrix, which represents the population dynamics of interacting species. The system’s asymptotic short- and long-term behaviour can be determined from eigenvalues derived from the community matrix. Here we use results from the theory of pseudospectra to describe intermediate, transient dynamics. We show that the transition from stable to unstable dynamics includes a region of transient instability, where the effect of a small perturbation is amplified before ultimately decaying. The shift from stability to transient instability depends on the magnitude of a perturbation, and we show how to determine lower and upper bounds to the maximum amplitude of perturbations. Of five different types of community matrix, we find that amplification is least severe with predatorprey interactions. This analysis is relevant to other systems whose dynamics can be expressed in terms of the Jacobian matrix. Through understanding transient instability, we can learn under what conditions multiple perturbations—multiple external shocks—will irrecoverably break stability.
http://arxiv.org/pdf/1506.06971.pdf
Caravelli, Staniczenko
https://wordpress.invenia.ca/wp-content/uploads/2016/06/multi1.png
Multi-scaling of wholesale electricity prices
We empirically analyze the most volatile component of the electricity price time series from two North-American wholesale electricity markets. We show that these time series exhibit fluctuations which are not described by a Brownian Motion, as they show multi-scaling, high Hurst exponents and sharp price movements. We use the generalized Hurst exponent (GHE, H(q)) to show that although these time-series have strong cyclical components, the fluctuations exhibit persistent behaviour, i.e., H(q)>0.5. We investigate the effectiveness of the GHE as a predictive tool in a simple linear forecasting model, and study the forecast error as a function of H(q), with q=1 and q=2. Our results suggest that the GHE can be used as prediction tool for these time series when the Hurst exponent is dynamically evaluated on rolling time windows of size ≈50−100 hours. These results are also compared to the case in which the cyclical components have been subtracted from the time series, showing the importance of cyclicality in the prediction power of the Hurst exponent.
http://arxiv.org/abs/1507.06219
Ashtari, Aste, Caravelli, Di Matteo, Requeima, Ududec
https://wordpress.invenia.ca/wp-content/uploads/2016/05/memr1.png
Scale-free networks as an epiphenomenon of memory
Many realistic networks are scale-free, with small characteristic path lengths, high clustering, and power law in their degree distribution. They can be obtained by dynamical networks in which a preferential attachment process takes place. However, this mechanism is nonlocal, in the sense that it requires knowledge of the whole graph in order for the graph to be updated. Instead, if preferential attachment and realistic networks occur in physical systems, these features need to emerge from a local model. In this paper, we propose a local model and show that a possible ingredient (which is often underrated) for obtaining scale-free networks with local rules is memory. Such a model can be realised in solid-state circuits, using non-linear passive elements with memory such as memristors, and thus can be tested experimentally.
http://arxiv.org/pdf/1312.2289.pdf
Caravelli, Di Ventra, Hamma

Join Us

Being a part of the Invenia Labs team presents an opportunity to work with and learn from amazing people with expertise in machine learning, theoretical physics, mathematics, complex systems, and computer science while contributing to research that has a positive impact on our society and the environment.

We find great purpose in our ability to change the world for the better. It's what drives us to to work hard and continuously improve. If our vision resonates with you and you are interested in joining us, please visit our career page at www.joininvenia.com to apply.
LOCATE US ON THE MAP
Invenia
This is us, drop by sometime.
Cambridge 95 Regent Street Cambridge
CB2 1AW United Kingdom