A Critical Approach to Summary Statistics and Graphs: 4.75

Supporting materials

 

Indicator of Progress

Students can produce summary statistics and graphical displays for given data sets. They are able to critically evaluate graphical displays and summary statistics. Evidence for this is when students can recognise misleading presentations of data.

Prior to this, students may have difficulty in identifying features of graphs or summary statistics that are misleading.

 

Illustration

Students will have developed skills at producing graphs and summary statistics both by hand and using appropriate technology. They now need to consider prepared graphs and summary statistics and identify when samples might be biased; the effect of outliers on summary statistics and inappropriately labelled or scaled axes. Students need to be able to read commercial publications and understand limitations of statistical evidence.

 

Teaching Strategies

One of the aims of school mathematics is to produce citizens with statistical literacy. As well as being able to conduct their own statistical investigations, students need to develop critical skills to evaluate the material that they may read.

Activity 1: Misleading graphical displays raises awareness of common ways in which graphical displays can be manipulated to tell the story that the writer wishes to portray.
Activity 2: Misleading displays in the news examines misleading displays in the media.
Activity 3: Misleading summary statistics in the news examines misleading or incorrect uses of summary statistics and of sampling procedures.
For activities 2 and 3, students may also be encouraged to collect their own examples.

 

Activity 1: Misleading graphical displays

This activity is intended to help students identify misleading representations of data. For example, axes may be scaled to make two groups appear close or distant. Students need to develop the ability to be critical readers of graphs.

The following graph displays the time allocated for Maths, Art and English each two weeks in a school. Students could be asked to explain what the graph shows, what might be the purpose of the graph and why it is misleading. They might also be requested to redraw the graph so that the graph is a fair representation of the situation, or alternatively to manipulate a graphical display to tell a false story.

Bar graph: No. minutes timetabled in 2 week period per subject

In the example below the vertical axis does not start at zero and the resulting graph suggests a huge decrease in the Australian dollar. Students could discuss why the graph has been presented in this way and note how the title of the graph is also used to persuade the reader that the drop in the Australian dollar is dramatic.

Dramatic fall in the Australian dollar

 

Activity 2: Misleading displays in the news

This activity encourages students to explore misleading graphical displays in the media.

Find an article in a local newspaper where a graphical display is chosen to favour a particular viewpoint.

Possible examples are:

  • An article where a company is made to look profitable due to the way data is presented.
  • Graphs showing median house prices over a number of years can often exclude some data which might be less favourable than that presented. Sometimes particular results are excluded in graphs related to house prices.
  • An article where the text presents a particular argument that is not supported by the graph shown.

Have a class discussion about how the graphical display could be misleading. It is important to discuss particular features of graphs and why they are misleading. Students should consider scale, labels of axes, etc. in relation to the questions being addressed and the interpretation placed on the graph.

Possible areas for discussion could include:

  • What the graph shows.
  • The scale on the axes and whether or not it is misleading.
  • The choice of graph for displaying the data.
  • Features of the graph that make it misleading.
  • The intended purpose of the graph and whether or not the graph is a fair representation for this purpose.

 

Activity 3: Misleading summary statistics in the news

This activity encourages students to explore misleading summary statistics and poor reporting of samples and sampling in the media.

Find an article in a newspaper where summary statistics are presented to favour a particular viewpoint or where the samples and sampling processes are unclear.

Possible examples are:

  • An article where a summary statistic is used incorrectly (for example, a call for everyone to be 'above average' on a particular characteristic).
  • An article where a company is made to look profitable due to the choice of summary statistic.
  • Statistics on house prices generally use the median, but sometimes interpret it as the mean or mode.

Have a class discussion about how the findings could be misleading or wrong.

Possible areas for discussion could include:

  • What the sample was, how it was chosen and how questions were asked.
  • The choice of the summary statistics for describing the data.
  • The sample size of the data displayed, or the lack of information about the sample.
  • The randomness or representativeness or possible bias of the sample.