S-branch are speaking at the IBM i2 and Brookcourt Solutions Threat and Counter Fraud Event.

Come and meet us.

If you’re looking into visual analysis products, you will have certainly considered i2. If you’d like to hear a customer user case, then we’d suggest attending the IBM i2 and Brookcourt Solutions Threat and Counter Fraud Event, on 21st February 2019.

We are speaking at the event with our partners Arquebus Solutions on Integrating Ballistic Intelligence – The Real Picture

IBM will be presenting valuable insights and knowledge on how to tackle Threat and Counter Fraud. S-branch was asked if it could give a real customer user case, showing how versatile i2 can be to tackle any kind of threat; in this case, the threat of firearms.

Arquebus provides specialised services and support to assist organisations enhance their response to firearms enabled crime and terrorism. With the support of S-branch, Arquebus has been deploying Firearm Focal Points (FFPs) to countries across Europe. FFPs are designed to collect all the necessary firearm information together, creating accurate investigative leads thereby helping both investigators and prosecutors to tackle the problem at source.

FFPs work because of data collaboration. Analysis of ballistic evidence has advanced hugely but this information should not be analysed on its own. If a cartridge case is found at a location what other crimes have we seen in that area? Were there any ‘shots fired’ call outs at that time? We may know that the cartridge case comes from a particular type of firearm. What intelligence do we have about trafficking those types of firearms? If we are lucky enough to find or have a match to a particular firearm; who is it registered to? Is there any link to other crimes?

We can only answer these questions if we have access to all the information. Analysis tools allow us to understand this information quickly, helping FFP’s provide accurate leads fast. S-branch will showcase how and why i2 was used to provide this functionality and discuss the results we have seen while deploying such a system.

Come see us at:

IBM i2 and Brookcourt Solutions Threat and Counter Fraud Event

Where: London

When: 21st February 2019, 1pm to 4:30pm

Please email to register your attendance. See the full agenda here.

Why Rosoka is the ‘no-brainer’ plug-in for IBM i2 Analyst’s Notebook

Why Rosoka is the ‘no brainer’ plug-in for IBM i2 Analyst’s Notebook

It’s no secret that i2® is a popular choice for visualising and analysing data. That’s why in 2011 IBM paid a rumoured $500 million to acquire the small British software company. Its flagship product: Analyst’s Notebook has now become the standard for charting data and is used in nearly all of the UK police forces. If you have a sporadic flow of data in formats that vary greatly, IBM i2 is still one of the most compelling tools on the market.

IBM i2® products have always worked well with structured data. This has given its users the ability to ‘bring to life’ data hidden in columns and rows. There are many other places that data can hide though and one of those places is in unstructured text.

Unstructured Data

Unstructured text can pose a challenge to analyse and understand, and we keep generating more of it every day. This text can be anywhere from documents, emails or social media posts. In March 2018 we wrote a blog detailing how data hidden in unstructured text can be utilised. It focussed on the use of Natural Language Processing and particularly Entity Extraction. You can read it here. That blog post concentrated on what could be done using freely available tools.

At the time we stated that there are many commercial offerings that offer that functionality but in a much slicker and easy to access interface. One of those tools is Rosoka Text Analytics. Rosoka is an industry leader of text analytics solutions. Their enterprise solution Rosoka Server is great for large scale analysis of unstructured data. This blog is about their standalone solution which is a plug-in for i2.

Rosoka

Rosoka Text Analytics

So, why is it a ‘no-brainer’?

Well, to start off with its fully integrated with IBM i2 Analyst’s Notebook. It’s a plug-in that has been created in close collaboration with IBM and you can tell. We tested the plug-in against several datasets, including the case study we used in the previous blog post. This data can be found here.

Here are the reasons why we think it’s a ‘no-brainer’ plug-in:

  • It extracts entities and links from unstructured files such as PDF’s, Word documents and txt files. It then allows users to generate Analyst’s Notebook charts based on the content
  • Processing time is quick compared to reading the documents manually and quicker than the free extraction engines used in our previous blog
  • During testing we found the entity extraction to be very accurate. What was more impressive was the relationship extraction. In our previous blog we inferred links based on how many times two entities are mentioned in the same document. What Rosoka do is far more sophisticated and is based on the language around the two entities
  • Entity extraction is good but it can create a lot of noise. Rosoka’ s use of Salience (relevance) means we could always find the most relevant extracted entities and ignore the others
  • Rosoka applies entity resolution to its extraction. This meant that if Theresa May is mentioned as ‘Theresa’, ‘Mrs May’ or even ‘She’ in a document, Rosoka will be able to resolve these different texts as one entity.
  • It’s easy to reclassify an extracted entity from say a person to a company (for example Robert Dyas the UK hardware store). Rosoka can also learn from your decisions so it doesn’t make the same mistake again
  • Rosoka is truly multilingual. We tested this by running several news articles about Islamic State through Rosoka in different languages. The organisation Islamic State was mentioned in both the Russian and the Arabic news articles. On the chart they were resolved into one entity, despite them originating from two different languages. That meant that when we expanded Islamic state we got linked items from both the Russian and the Arabic articles.
  • The most surprising reason Rosoka is a no-brainer though is the price. For a fraction of the cost of IBM i2 Analyst’s Notebook the plug-in delivers accurate, multilingual, unstructured data analysis. We’ve looked at costs for this type of technology for clients before and often the requirements were dropped, due to budget restrictions; well not with Rosoka!

In conclusion, we believe Rosoka is a ‘no-brainer’ plug-in for i2 Analyst’s Notebook. The functionality, ease of use and price will just make any analysts life easier!

For more information on Rosoka visit their website or contact S-branch. If you’d like to find out more about unstructured data analysis, then feel free to call.

S-branch offers independent advice, meaning if Rosoka is not for you at this time, we can help you find the solution that is.

i2 iBase dashboards with PowerBI – Unlock your data

iBase and PowerBI - Unlock your data

Who doesn’t love a good dashboard? What better way to gain a high-level understanding of your data than to see it come alive in bright colours before your eyes? They’re great for presentations but can also give valuable insights into where the peaks and troths in your data lie. From an analytical perspective, it can give you a starting point for your analysis; which with large datasets is very useful.

Dashboards need data. i2 users will store most of their data in iBase; which is very sensible. They do this because items can be quickly retrieved using the intuitive search tools, while the details and hidden connections are easily drilled down upon using i2 Analyst’s Notebook.

It is not always possible, or indeed sensible to place your entire iBase database onto an Analyst’s Notebook chart.

So i2 users have the data, they also have the ability to drill down into the detail. What they sometimes lack is the high-level statistics that a dashboard can provide.

Analyst’s Notebook – Bar Charts and Histograms

One way of doing this is to use the Bar Charts and Histograms functionality within Analyst’s Notebook. This functionality has proven itself very popular as it provides interactive statistical information. The only limitation to this functionality is: it only works with data that is on an Analyst’s Notebook Chart. Statistical information works best with lots of data and it is not always possible, or indeed sensible to place your entire iBase database onto an Analyst’s Notebook chart.

PowerBI

Power BI is a dashboard and reporting analytics tools that can connect to existing data sources and deliver insights that might otherwise have been missed. It allows its users to produce beautiful, interactive reports and then publish them for your organization to consume.

The example below shows national crime information. The data (although fake) is being held in an iBase database. The dashboard shows a location heat map (top left), number of crimes by type (top right), crimes by ward (bottom left) and crimes by date (bottom right).

PowerBI Crime Type Dashboard

PowerBI is interactive, meaning a user can drill down into a specific area of the data. In the example below a user has concentrated on pedal cycle crime.

PowerBi Pedal Crime Dashboard

From here the user can glean insights into this crime type. They can see the areas of the country that have the most pedal cycle crime. The time of the year which it most occurs (July to October) and which wards are most affected (Thames Valley Police and Cambridgeshire).

This can assist with strategic planning. If tasked with reducing pedal bike crime, a team could concentrate on university towns (Thames Valley and Cambridgeshire both hold large universities) between the date ranges of July to October.

What’s the catch?

In order to use iBase data with PowerBI you need a good understanding of your iBase security set-up and the underlying table structure; both of which S-branch can help you with. Regarding costs, the desktop version of PowerBI is free; yes free. This allows users to produce dashboards locally. Most organisations will choose a paid for package where they publish dashboards other colleagues within their organisation. To view a published dashboard all that is needed is a web browser.

For more information on PowerBI, visit the website here. For information on how to integrate it with your iBase implementation (new or old) please contact us

Tackling duplicate data in i2

Smart Matching

Duplicates in data is always an issue. An issue which is magnified once you start trying to load said data into a visual analysis tool like i2. The nature of tools like i2 is that they find connections between entities; in order for that to work the data must be clean a free of duplicates.

In reality, it’s not always feasible or realistic to get rid of all duplicates. For this reason, the i2 analysis suite does provide some matching functionality

Smart Matching – i2 Analyst’s Notebook

To explain it in a simple way: Smart matching in analyst’s notebook is achieved by categorising entities and applying almost human matching logic.

For example, a visualisation may contain a police officer, a victim, a suspect, a prisoner, a male and a female entity. These entities could all be categorised as People. As humans, we could look at a list of people and would instinctively apply matching logic. We’d know that date of birth was important. As are surnames, although they may change when someone marries. We know that Chris could be spelt in several different ways and (as with any data) there may be spelling mistakes.

i2 smart matching can do the same thing. It will apply a different set of logic to different categories of entities to give an almost human matching ability.

Smart matching example

Smart matching example

Great! Problem solved! Well yes, if you have a smallish set of data then smart matching will work well. However, for smart matching to work, the entities need to be on an analyst’s notebook chart. This may start becoming an issue once you hit the 20,000 entities mark! You could try some kind of batching process but it’s likely to be time-consuming and not entirely accurate.

 

Matching in iBase

Matching in iBase example

Matching in iBase example

iBase will not have this problem. Being a database it will have access to all of your records without needing to render them on a visual chart. The problem we have in iBase is it doesn’t have access to the same smart matching logic. With iBase we can match someone with exactly the same surname. Or, the exact same surname and date of birth. While useful, this will miss a lot of duplicates and therefore needs to be used with care.

Custom Matching Functionality

For some of our clients, the functionality described above didn’t meet their needs. They either had too many entities or wanted to find duplicates of completely different entity types, or maybe over different databases.

For these clients s-branch developed an external matching solution, using an existing string matching theory called Levenshtein distance. Levenshtein distance is a string metric for measuring the difference between two sequences. Informally, the Levenshtein distance between two words is the minimum number of single-character edits (insertions, deletions or substitutions) required to change one word into the other. What’s great about using Levenshtein distance is that it gives us a score. Meaning we can see narrow down our results to only the most relevant matches.

Custom matching example

Custom matching example

The external matching is computed outside of iBase. This is done to minimalise the effect on database performance but also allows us to iterate through entire datasets programmatically. This means we can compare duplicates regardless of whether they are the same entity type; or even the in the same database. The output from this is a matching score which is then imported into iBase as a ‘AutoMatch’ link. Our clients can then use existing iBase functionality, such as queries and sets to review the matches found and if applicable merge them through the normal UI.

You can read more on Levenshtein distance here.  To find out more about using Levenshtein distance with iBase or to discuss your own duplicate problem, please contact us

INTERPOL Firearm Forensics Symposium (IFFS) – 2017

In October 2017 I was asked by Arquebus Solutions to speak at the IFFS, an event designed for individuals who investigate firearms-related crimes, heads of police agencies and those who shape policy aimed at combating firearm crime.

It was an honour and a privilege to speak at such an event. It was also fascinating and humbling to hear experts share lessons learned following the recent terrorist attacks in Europe and other parts of the world.

Firearm Focal Points

One point which was consistent throughout the event was Firearm Focal Points (FFPs). FFPs are designed to collect all the necessary firearm information together, creating accurate investigative leads thereby helping both investigators and prosecutors to tackle the problem at source.

Firearm Focal Point

Firearm Focal Point

FFPs work because of data collaboration. Analysis of ballistic evidence has advanced hugely but this information should not be analysed on its own. If a cartridge case is found at a location what other crimes have we seen in that area? Were there any ‘shots fired’ call outs at that time? We may know that the cartridge case comes from a particular type of firearm. What intelligence do we have about trafficking those types of firearms? If we are lucky enough to find or have a match to a particular firearm; who is it registered to? Is there any link to other crimes?

We can only answer these questions if we have access to all the information. Analysis tools allow us to understand this information quickly, helping FFP’s provide accurate leads fast. It was my job to showcase how analysis tools can aid investigations when this data is made available.

Arquebus and I worked together to implement the Kosovo FFP. The success of this deployment was collaborated by Kosovo Police, who also spoke at the conference. It was with great pride that I listened to real cases where the collaboration of ballistic and crime information had aided investigations.

Crime in Action

A unique feature of IFFS 2017 was the ‘Crime in Action’ simulation, which ran through the entire conference. Subject experts shared their experiences and expertise not only through presentations and interactive panel discussions but also as part of a ‘crime in action’ scenario.

IFFS

IFFS

It was great to see all of the skills and expertise employed in dealing with a live gun crime investigation, but also to see how areas such a legislation, policy making, joint working arrangements and international development all play a part in how we deal with gun crime and illicit arms trafficking.

The highlights for me were visiting a simulated gun crime scene and the final arrest which occurred in the middle of the conference, much to the surprise and delight of the delegates.

In summary, it was one of the best conferences I’ve attended and I hope to return either as a delegate or presenter in the future.