Submission to the Productivity Commission: data availability and use

The Data Availability and Use Inquiry

The Productivity Commission is carrying out a 12-month public inquiry to improve the availability and use of public and private sector data ( and is required to:

  • look at the benefits and costs of making public and private datasets more available
  • examine options for collection, sharing and release of data
  • identify ways consumers can use and benefit from access to data, particularly data about themselves
  • consider how to preserve individual privacy and control over data use.

Community Insight Australia made a submission that focused on the value of small area data. We described the datasets of high value to our subscribers as:

  • Aggregated by small area: it is not necessary to know the addresses of individuals to make evidence-based decisions for communities
  • Granular: the smaller the granularity, the higher the value for decision making
  • Easily accessible: if datasets have a hyperlink, they can checked by anyone who wants to verify their origin and accuracy
  • Related to the most vulnerable people: the more vulnerable the person, the more they benefit from providers better serving them.

We made several recommendations that we believe will enhance the availability and use of data in Australia. Our recommendations are based on our own experiences over the last two years.


1. Promote small area datasets as a good way to release data while maintaining confidentiality

Custodians are rightly concerned with maintaining the privacy of the individuals that are the subject of their data. Many datasets are a collection of information pertaining to individuals, such that each person has a number of fields of information relating to them. One of these fields is often their address. We have found that data custodians are reluctant to release datasets that contain address information, or if they do release it, it’s aggregated into such large areas (like states) that its spatial value is lost. One way to solve this problem, and still maintain confidentiality, is to aggregate addresses into small geographical areas.

CIA snapshot - Brisbane- unemployed and looking for work blue.png

For many government, community and commercial organisations, information aggregated into small areas can be used to make their work much more efficient and effective. As technology to process, display and analyse small area datasets advances, it becomes quicker and easier to use this information to add value to important decisions. Aggregating fields of information by grouping individuals who live or work in small geographical areas can protect the identity of those individuals. A minimum field (e.g. <15) can be set for small counts to protect the identification of individuals.

Custodians should consider small area aggregation as an option for their datasets and be able to access resources to help them publish in this manner.

2.  Identify and clearly signpost the people and resources within government that can educate data custodians about how to release data

We have found that we are educating data custodians about how to release data in a way that is valuable to external organisations, but maintains the confidentiality of the data subjects. It would be great if this role existed inside government. It took us over a year to connect with the regional dataset team in the ABS, who can help data custodians with their releases, but may not have the resources to do so. As well as having resources to assist with data release, custodians need to be able to locate those resources easily. Contacts and resources for data custodians should be clearly signposted in obvious places like and its state equivalents. These resources should include clear and accurate information on legislation and policy around data release and should be public, so that internal and external agencies can have informed conversations.

3.  Identify and clearly signpost the people within government who can approve or advise on data release for custodians

One of the most significant barriers to data release is the lack of clarity around governing legislation and policy. This is compounded by a cultural reluctance to share information. Agencies are risk averse around releasing data and lack confidence in what might happen to their programs and clients as a result of the data being used. A government authority that is familiar with the legislation and policy and can advise on release would solve this issue. This proposed authority would have a different role from that of the open data policy teams who advocate for the release of more data. The proposed authority would need to understand the minutiae of the relevant laws and policies, and the technical processes of organizing and releasing data that can help custodians to comply.

4.  Include someone with technical skills in open data policy teams

We have found that those in government advocating for open data and those in government who are custodians of data are not connected to each other, and that we are playing this connecting role from outside government. To date, the role of open data policy teams has focused on advocacy while the needs of data custodians in terms of making their data open are quite technical. Open data teams are doing a great job and we’re seeing a lot of great policy released, but in order to implement these policies, the teams need to include or work closely with those with the requisite technical skills. Open data policy teams need to include people with the capability to actually help custodians open their data. Over time, this should include a cross-over of technical processes and knowledge between custodians and open date policy teams so that the process of opening data becomes more efficient and less costly.

5.  Work with local governments to retain data in smaller areas

In several states, local governments are merging to create larger jurisdictions. We run the risk of losing richness in data categorised by local government area as part of this process. As the mergers progress, collectors and custodians should make efforts to maintain as much as possible the smaller data collection areas in their new systems. This data would be able to be aggregated to the new Local Government Area, but could still be split into the previous smaller councils for analysis.


6.  Make it easier to request datasets

It is currently very difficult to find the appropriate person within a government department to contact about a dataset and then figure out the correct process to request the release of that dataset. Most of the processes available assume that the data is being requested for a one-off use and ask us to detail the intended use of the data before it is released. We have found that there is usually no process for requesting that datasets be released publicly. It would be more efficient and transparent to have a single point of contact in each government department that can direct traffic to the right custodian or a publicly available list of data custodians with a description of their data.  We envisage this role to be analogous to a freedom of information officer.

7.  Encourage custodians to remove barriers such as logins to see particular datasets

Some custodians require users to log in to access their datasets, for example Transport for NSW. This means that when a data point is referenced, there are several more steps to checking its source, which means people are less likely to do it. To encourage evidence-based decisions, we need to allow decision-makers to quickly view raw data.



8.  Create a process to standardise the definitions of state data

The collections of the productivity commission have created standardisation for a lot of state data.

Commencing a dialogue about standardizing other data collections would be the first step in a long process of using the same definitions, collection timeframes and geographical categories across all state data.

Comparable state datasets would enable linkage projects, help states learn from each other and also make life easier for organisations that work across state borders.

Users of data

When public data is made available, its value is often limited by the assumption that its audience is individual community members making personal decisions. The My School website is a good example of this ( While this in an important audience, it’s not the only one. At the other end of the scale, Transport for NSW ( has assumed that the primary audience for their data is app developers, which creates barriers for other users to access their datasets.

To maximise the value of data, it needs to be available or adaptable to the broader range of audiences that want to use it. Any publisher of data should check that it’s easy to find and download their raw data, before tailoring it to a specific audience.

We take raw data and make it meaningful to organisations making location-based decisions for people in need. Users of our data platform include government departments and not-for-profits. These organisations are important consumers of public data and use it to make valuable decisions for services in our communities.

It’s interesting that the scope of this Productivity Commission inquiry looks to “provide examples of public sector datasets that would provide high value to:

  • the public sector,
  • research sector,
  • academics and
  • the community.”

Missing from the list are not-for-profits and commercial businesses, organisations that are increasingly delivering government services. These organisations could vastly improve their service planning and delivery if they had better access to public sector datasets.

Uses of data

Examples of decisions that could be improved with better access to spatial data

Sara– proposing a parenting support program

Sara is proposing a new parenting support program in response to a WA Government tender. The government wants to target young families by providing weekly support and connections to local services. Sara’s organisation has a strong presence in Belmont, East Vic Park, Kelmscott and Morley, so she defines each of the areas in Community Insight Australia.

productivity commission slide 3.pngShe can see that, of the four areas, East Vic Park has the highest percentage of children under 5. She uses the heat map to find out that there are 1010 children under 5.

productivity commission slide 4.png

productivity commission slide 5.pngShe also discovers that there are 616 households that do not own a car.

She designs her program to cater to the community of East Vic Park and builds the cost of a mini-bus and children’s car seats into her budget.

Sara can do all of this using data from the census, but she wishes she had access to child protection information for each of the areas under consideration so that she could target the area where a parenting support program could most help families with young children at risk.

Ari – evaluating the tender

Ari works for the WA Government and is evaluating the responses to the tender for parenting support programs mentioned in the above example. He makes a shortlist of the top proposals, and then defines the areas each proposes to work in. He downloads a report on each of these areas and judges each tender on whether it meets the needs of the community proposed. The parenting program is part of a government-wide push to intervene earlier with children who develop anti-social and criminal behaviour. He wishes he could easily map the home suburbs of the children appearing in children’s court, so that he could target communities where youth crime is a particular problem. If he’d had access to that data as he wrote the tender, he could have asked organisations to propose programs in those areas from the start.

Jane – Buying new properties for community housing

Jane is on the assets management team of a community housing organisation. They are doing a strategic review of properties they own, trying to decide where to sell and where to buy. She creates ‘neighbourhoods’ by drawing around the areas they currently own in and areas they are considering investing in. She uses the dashboard to compare the economic descriptors of people in these communities and their median house prices, which informs the team’s discussion on the trade-offs between where they can afford to buy and where their tenants will thrive. Part of the work of the organisation is to support homeless people into housing. Jane wishes they had access to the areas where specialist homelessness services are in greatest demand, so that they could look for properties that didn’t ask people to relocate too far away from their support networks.

Additional example of high value datasets for the public sector, researchers, community organisations and individuals

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s