Data Visualization in R

Data visualization is an important part of exploring, understanding, and sharing our data.

Data visualization is a critical part of the data science workflow. Through visualization we can explore and understand our own data, ultimately informing further analyses. Additionally, data visualizations are a powerful tool for communicating data and research findings to other people. Visuals can often more efficiently and more effectively tell the story of your data, rather than only relying on writing. Well done data visualizations will often have the biggest impact on an audience in a science communication context.

Source

Let’s get started!

Types of Data Visualization

Data visualizations can be descriptive in nature, such as portraying the demographic distribution of a group of people, or can represent statistical findings, such as a regression line with a confidence interval overlaid on a scatter plot of data. In certain contexts it is also common to present data and information in more easily digestible infographics (check out some examples here) that enter more of a graphic design space. Different data visualizations fulfill different goals. Having a toolbox of a variety of data visualization types can help you pick the best type to fit your needs for a given project.

Table

Tables to collect and organize data are one of the most common and basic data visualizations. But don’t discount them! They can be efficient ways to convey a large amount of information about your data all at once.

Pie Chart

A classic pie chart is useful for representing parts that add up to a whole. This also allows for comparing group sizes. They are often used for demographic variables, with the whole representing the whole sample, or for representing money, with the whole representing a budget or total money spent/made. Be careful to use a pie chart only when it really adds to the story. For instance, if there are only two parts to the whole, a pie chart might not convey much more information. Conversely, if there are many groups, it can become difficult to really see all of them and compare them.

Box Plots

Box plots (also known as box and whisker plots) are good for understanding and comparing variance between groups. They typically depict the median and minimum/maximum of each group for a certain variable. The box portion represents the 1st and 3rd quartiles of the distribution. You can also show change over time with this type of plot.

Histogram

Histograms display the distribution of one variable. The height of the bar represents how many times that value was represented in the data. This is typically what you view if you want to visually inspect if a variable is normally distributed.

Bar Chart

Bar charts are good for representing data from groups or categories, with the bars representing different categories. The bar height usually represent a mean, a count, or a percentage, by category. These can be useful for comparing groups or showing change over time.

Scatter Plot

Scatter plots include data points that are plotted along an x and y axis, showing the relationship between these two variables. Often researchers add a line to these plots to show the statistical relationship between the variables.

Line Chart

Line charts use connected straight lines to display data. They are good for showing change over time on a continuous variable. They are often similar in purpose to bar charts, but visually simpler if there are many time points. An example of where we often see line charts used in the news is to visualize the stock market. (Plotting the various age groups here is not particularly meaningful since this data was only collected at one time point, but is used to illustrate this type of data visualization.)

Interactive Data Visualizations

As research and publications move more online and away from print, this can allow for more interactive data visualizations. These are types of data visualizations that allow a person to select and change what is being shown. Check out this great example from Gapminder. The default visualization shows GDP and life expectancy over time, and by country. However, you can change the variables included to view other data.

So many more!

  • Heat Map
  • Stacked Bar or Stacked Area Chart
  • Violin Plot
  • Gantt Chart
  • Choropleth Map

What Makes a Good Visualization?

There is an art to picking the best data visualization that fits your data and the story you are telling. By nature, data visualizations are abstract representations of our data, with color, shape, and position representing the data points. This both hides the exact data itself, while also allowing us to highlight bigger picture ideas about the data, depending on what we choose to emphasize. When deciding on what type of data visualization to use, consider the following:

  • What question are you exploring with your data and how will it inform future analyses?
  • What is your data visualization adding to your science communication?
  • What take-away message are you conveying with the image?
  • What type of variables do you have? Continuous? Categorical? And what type of abstraction (e.g., color, shape) best suits that variable?
  • Are you comparing groups?
  • Are you showing change over time?
  • Are you visualizing a relationship between variables?

It can be easy to get in the habit of using the same types of data visualization over and over again. Check out this website that gives many creative data visualization options (with R code!), categorized by goal: https://r-graph-gallery.com/

Good Data Visualization Princicples

Once you pick the format that fits your needs best, these are some principles to keep in mind when crafting your visualization to make sure it is clear to your audience.

Principle Considerations
Clear Data Consider the format of your data when you include it. Your data needs to be unambiguously communicated to your audience. For instance, do you have so many groups that they are difficult to differentiate? Are your data points stacked on the same spot so the audience can’t see the density of your data points?
Clear Labels All data visualizations need labels. This may be the axis on a scatter plot, legends for your bar graph, or percentages on your pie chart. You must tell the audience what they are looking at. If different colors are used, they should represent some aspect of the data and be clearly labeled.
Clear Scales Clear and consistent scales are important to avoid misinterpretation of your data visualization. An axis should be clearly labeled and include the full scale range. Make it clear if the scale does not start at 0. Scales should be consistent across visualizations to allow for comparisons.
Simplicity Aim to have uncluttered data visualizations. It is easy to get excited about all you can do creatively in the world of data visualizations, but sometimes adding too much (e.g., extra colors, pictures) can actually obscure your main message. Avoid extra info that doesn’t add to the story you are telling.
Accessibility Consider how your data visualization design would be viewed by a variety of people. Text font and size for legends and axis labels should be clear and not too small. Try not to rely only on color to distinguish groups (e.g., lines can be dashed or dotted), or pick colors/hues that are distinguishable by people who are colorblind. Include alternative text descriptions that can be read aloud by a screen reader.

For more information on design principles and the visual hierarchy of elements, check out this article. Size, color, contrast, alignment, repetition, proximity, whitespace, and texture can all be used to draw focus to particular visual elements.

Your Turn!

One of the best ways to get into data visualization is to get inspired from some of the amazing data visualizations that already exist!

We have two websites with a variety of data visualization examples.

  • R Graph Gallery Includes many examples of data visualizations created in R. These also include tutorials/R Code used to make them. These examples go beyond what we will cover in this workshop, but serve as great inspiration for how much you can do in R!

  • Tableau Viz Gallery Includes examples created with the platform Tableau. This is a proprietary (paid) platform which we are not using in this workshop, but this gallery still has some great examples to help inspire your data visualization creativity!

In small groups, on either of these websites, find a data visualization example that jumps out to you as interesting and then answer the following questions.

  1. What captured your attention about this data visualization? The topic? The design?
  2. What is the story this example is trying to tell? What is one of the take-away messages it is conveying?
  3. What do you like about this visualization? Does it convey information about the data in a uniquely effective way? Does it adhere to the principles we discussed?
  4. Is there anything you find confusing about this example? Anything you think is missing or that you would change to improve it?
LS0tDQp0aXRsZTogIlR5cGVzIG9mIFZpc3VhbGl6YXRpb25zIg0KcGFnZXRpdGxlOiAiVHlwZXMgb2YgVmlzdWFsaXphdGlvbnMiDQpvdXRwdXQ6DQogIGh0bWxfZG9jdW1lbnQ6DQogICAgY29kZV9mb2xkaW5nOiBzaG93ICMgYWxsb3dzIHRvZ2dsaW5nIG9mIHNob3dpbmcgYW5kIGhpZGluZyBjb2RlLiBSZW1vdmUgaWYgbm90IHVzaW5nIGNvZGUuDQogICAgY29kZV9kb3dubG9hZDogdHJ1ZSAjIGFsbG93cyB0aGUgdXNlciB0byBkb3dubG9hZCB0aGUgc291cmNlIC5SbWQgZmlsZS4gUmVtb3ZlIGlmIG5vdCB1c2luZyBjb2RlLg0KICAgIGluY2x1ZGVzOg0KICAgICAgYWZ0ZXJfYm9keTogZm9vdGVyLmh0bWwgIyBpbmNsdWRlIGEgY3VzdG9tIGZvb3Rlci4NCiAgICB0b2M6IHRydWUNCiAgICB0b2NfZGVwdGg6IDMNCiAgICB0b2NfZmxvYXQ6DQogICAgICBjb2xsYXBzZWQ6IGZhbHNlDQogICAgICBzbW9vdGhfc2Nyb2xsOiBmYWxzZQ0KLS0tDQoNCmBgYHtyLCBsaWJyYXJpZXMsIGluY2x1ZGUgPSBGQUxTRX0NCmxpYnJhcnkoa2FibGVFeHRyYSkNCmxpYnJhcnkoZ2dwbG90MikNCmxpYnJhcnkoZHBseXIpDQpgYGANCg0KYGBge3Igc2V0dXAsIGluY2x1ZGU9RkFMU0V9DQprbml0cjo6b3B0c19jaHVuayRzZXQoZWNobyA9IFRSVUUsIG1lc3NhZ2UgPSBGQUxTRSwgd2FybmluZ3MgPSBGQUxTRSkNCmBgYA0KDQoNCiMjIERhdGEgVmlzdWFsaXphdGlvbiBpbiBSDQoNCjo6OmludHJvDQpEYXRhIHZpc3VhbGl6YXRpb24gaXMgYW4gaW1wb3J0YW50IHBhcnQgb2YgZXhwbG9yaW5nLCB1bmRlcnN0YW5kaW5nLCBhbmQgc2hhcmluZyBvdXIgZGF0YS4NCjo6Og0KDQpEYXRhIHZpc3VhbGl6YXRpb24gaXMgYSBjcml0aWNhbCBwYXJ0IG9mIHRoZSBkYXRhIHNjaWVuY2Ugd29ya2Zsb3cuIFRocm91Z2ggdmlzdWFsaXphdGlvbiB3ZSBjYW4gZXhwbG9yZSBhbmQgdW5kZXJzdGFuZCBvdXIgb3duIGRhdGEsIHVsdGltYXRlbHkgaW5mb3JtaW5nIGZ1cnRoZXIgYW5hbHlzZXMuIEFkZGl0aW9uYWxseSwgZGF0YSB2aXN1YWxpemF0aW9ucyBhcmUgYSBwb3dlcmZ1bCB0b29sIGZvciBjb21tdW5pY2F0aW5nIGRhdGEgYW5kIHJlc2VhcmNoIGZpbmRpbmdzIHRvIG90aGVyIHBlb3BsZS4gVmlzdWFscyBjYW4gb2Z0ZW4gbW9yZSBlZmZpY2llbnRseSBhbmQgbW9yZSBlZmZlY3RpdmVseSB0ZWxsIHRoZSBzdG9yeSBvZiB5b3VyIGRhdGEsIHJhdGhlciB0aGFuIG9ubHkgcmVseWluZyBvbiB3cml0aW5nLiBXZWxsIGRvbmUgZGF0YSB2aXN1YWxpemF0aW9ucyB3aWxsIG9mdGVuIGhhdmUgdGhlIGJpZ2dlc3QgaW1wYWN0IG9uIGFuIGF1ZGllbmNlIGluIGEgc2NpZW5jZSBjb21tdW5pY2F0aW9uIGNvbnRleHQuIA0KDQohW10oaW1hZ2VzL3RpZHl2ZXJzZS13b3JrZmxvdy5wbmcpDQpbU291cmNlXShodHRwczovL3RlbGFwcHMubG9uZG9uLmVkdS9hbmFseXRpY3Nfd2l0aF9SL3RpZHl2ZXJzZS5odG1sKQ0KDQoNCkxldCdzIGdldCBzdGFydGVkISANCg0KIyMjIFR5cGVzIG9mIERhdGEgVmlzdWFsaXphdGlvbg0KDQpEYXRhIHZpc3VhbGl6YXRpb25zIGNhbiBiZSBkZXNjcmlwdGl2ZSBpbiBuYXR1cmUsIHN1Y2ggYXMgcG9ydHJheWluZyB0aGUgZGVtb2dyYXBoaWMgZGlzdHJpYnV0aW9uIG9mIGEgZ3JvdXAgb2YgcGVvcGxlLCBvciBjYW4gcmVwcmVzZW50IHN0YXRpc3RpY2FsIGZpbmRpbmdzLCBzdWNoIGFzIGEgcmVncmVzc2lvbiBsaW5lIHdpdGggYSBjb25maWRlbmNlIGludGVydmFsIG92ZXJsYWlkIG9uIGEgc2NhdHRlciBwbG90IG9mIGRhdGEuIEluIGNlcnRhaW4gY29udGV4dHMgaXQgaXMgYWxzbyBjb21tb24gdG8gcHJlc2VudCBkYXRhIGFuZCBpbmZvcm1hdGlvbiBpbiBtb3JlIGVhc2lseSBkaWdlc3RpYmxlIGluZm9ncmFwaGljcyA8YSBocmVmPSJodHRwczovL2Nvb2xpbmZvZ3JhcGhpY3MuY29tLyI+KGNoZWNrIG91dCBzb21lIGV4YW1wbGVzIGhlcmUpPC9hPiB0aGF0IGVudGVyIG1vcmUgb2YgYSBncmFwaGljIGRlc2lnbiBzcGFjZS4gRGlmZmVyZW50IGRhdGEgdmlzdWFsaXphdGlvbnMgZnVsZmlsbCBkaWZmZXJlbnQgZ29hbHMuIEhhdmluZyBhIHRvb2xib3ggb2YgYSB2YXJpZXR5IG9mIGRhdGEgdmlzdWFsaXphdGlvbiB0eXBlcyBjYW4gaGVscCB5b3UgcGljayB0aGUgYmVzdCB0eXBlIHRvIGZpdCB5b3VyIG5lZWRzIGZvciBhIGdpdmVuIHByb2plY3QuIA0KDQojIyMjICoqVGFibGUqKg0KVGFibGVzIHRvIGNvbGxlY3QgYW5kIG9yZ2FuaXplIGRhdGEgYXJlIG9uZSBvZiB0aGUgbW9zdCBjb21tb24gYW5kIGJhc2ljIGRhdGEgdmlzdWFsaXphdGlvbnMuIEJ1dCBkb24ndCBkaXNjb3VudCB0aGVtISBUaGV5IGNhbiBiZSBlZmZpY2llbnQgd2F5cyB0byBjb252ZXkgYSBsYXJnZSBhbW91bnQgb2YgaW5mb3JtYXRpb24gYWJvdXQgeW91ciBkYXRhIGFsbCBhdCBvbmNlLiANCg0KIVtdKGltYWdlcy9kYXk0X2V4YW1wbGV0YWJsZS5wbmcpDQoNCiMjIyMgKipQaWUgQ2hhcnQqKg0KQSBjbGFzc2ljIHBpZSBjaGFydCBpcyB1c2VmdWwgZm9yIHJlcHJlc2VudGluZyBwYXJ0cyB0aGF0IGFkZCB1cCB0byBhIHdob2xlLiBUaGlzIGFsc28gYWxsb3dzIGZvciBjb21wYXJpbmcgZ3JvdXAgc2l6ZXMuIFRoZXkgYXJlIG9mdGVuIHVzZWQgZm9yIGRlbW9ncmFwaGljIHZhcmlhYmxlcywgd2l0aCB0aGUgd2hvbGUgcmVwcmVzZW50aW5nIHRoZSB3aG9sZSBzYW1wbGUsIG9yIGZvciByZXByZXNlbnRpbmcgbW9uZXksIHdpdGggdGhlIHdob2xlIHJlcHJlc2VudGluZyBhIGJ1ZGdldCBvciB0b3RhbCBtb25leSBzcGVudC9tYWRlLiBCZSBjYXJlZnVsIHRvIHVzZSBhIHBpZSBjaGFydCBvbmx5IHdoZW4gaXQgcmVhbGx5IGFkZHMgdG8gdGhlIHN0b3J5LiBGb3IgaW5zdGFuY2UsIGlmIHRoZXJlIGFyZSBvbmx5IHR3byBwYXJ0cyB0byB0aGUgd2hvbGUsIGEgcGllIGNoYXJ0IG1pZ2h0IG5vdCBjb252ZXkgbXVjaCBtb3JlIGluZm9ybWF0aW9uLiBDb252ZXJzZWx5LCBpZiB0aGVyZSBhcmUgbWFueSBncm91cHMsIGl0IGNhbiBiZWNvbWUgZGlmZmljdWx0IHRvIHJlYWxseSBzZWUgYWxsIG9mIHRoZW0gYW5kIGNvbXBhcmUgdGhlbS4gDQoNCiFbXShpbWFnZXMvZGF5NF9waWVjaGFydGV4YW1wbGUucG5nKQ0KDQojIyMjICoqQm94IFBsb3RzKioNCkJveCBwbG90cyAoYWxzbyBrbm93biBhcyBib3ggYW5kIHdoaXNrZXIgcGxvdHMpIGFyZSBnb29kIGZvciB1bmRlcnN0YW5kaW5nIGFuZCBjb21wYXJpbmcgdmFyaWFuY2UgYmV0d2VlbiBncm91cHMuIFRoZXkgdHlwaWNhbGx5IGRlcGljdCB0aGUgbWVkaWFuIGFuZCBtaW5pbXVtL21heGltdW0gb2YgZWFjaCBncm91cCBmb3IgYSBjZXJ0YWluIHZhcmlhYmxlLiBUaGUgYm94IHBvcnRpb24gcmVwcmVzZW50cyB0aGUgMXN0IGFuZCAzcmQgcXVhcnRpbGVzIG9mIHRoZSBkaXN0cmlidXRpb24uIFlvdSBjYW4gYWxzbyBzaG93IGNoYW5nZSBvdmVyIHRpbWUgd2l0aCB0aGlzIHR5cGUgb2YgcGxvdC4gDQoNCmBgYHtyLCBlY2hvID0gRkFMU0V9DQpnZ3Bsb3QoanNfZGF0YSwgYWVzKHg9YXMuZmFjdG9yKHByb3ZpbmNlX2ZhY3QpLCB5PWR1clNsZWVwKSkgKyANCiAgICBnZW9tX2JveHBsb3QoZmlsbD0iIzJENUU3RiIsIGFscGhhPTAuNikgKyANCiAgICB4bGFiKCJQcm92aW5jZSIpICsNCiAgICB5bGFiKCJNaW51dGVzIFNsZWVwaW5nIikgKw0KIHRoZW1lKHRleHQgPSBlbGVtZW50X3RleHQoc2l6ZSA9IDE4KSkNCmBgYA0KDQojIyMjICoqSGlzdG9ncmFtKiogDQpIaXN0b2dyYW1zIGRpc3BsYXkgdGhlIGRpc3RyaWJ1dGlvbiBvZiBvbmUgdmFyaWFibGUuIFRoZSBoZWlnaHQgb2YgdGhlIGJhciByZXByZXNlbnRzIGhvdyBtYW55IHRpbWVzIHRoYXQgdmFsdWUgd2FzIHJlcHJlc2VudGVkIGluIHRoZSBkYXRhLiBUaGlzIGlzIHR5cGljYWxseSB3aGF0IHlvdSB2aWV3IGlmIHlvdSB3YW50IHRvIHZpc3VhbGx5IGluc3BlY3QgaWYgYSB2YXJpYWJsZSBpcyBub3JtYWxseSBkaXN0cmlidXRlZC4gDQoNCmBgYCB7ciwgZWNobyA9IEZBTFNFfQ0KDQpnZ3Bsb3QoanNfZGF0YSwgYWVzKHg9ZHVyU2xlZXApKSArIA0KICBnZW9tX2hpc3RvZ3JhbShmaWxsID0gIiMyRDVFN0YiLCBjb2xvciA9ICJibGFjayIpKw0KICB4bGFiKCJOdW1iZXIgb2YgTWludXRlcyBTbGVlcGluZyIpICsNCiAgeWxhYiAoIk51bWJlciBvZiBQYXJ0aWNpcGFudHMiKSArDQogIHRoZW1lKHRleHQgPSBlbGVtZW50X3RleHQoc2l6ZSA9IDE4KSkNCmBgYA0KDQojIyMjICoqQmFyIENoYXJ0KiogDQpCYXIgY2hhcnRzIGFyZSBnb29kIGZvciByZXByZXNlbnRpbmcgZGF0YSBmcm9tIGdyb3VwcyBvciBjYXRlZ29yaWVzLCB3aXRoIHRoZSBiYXJzIHJlcHJlc2VudGluZyBkaWZmZXJlbnQgY2F0ZWdvcmllcy4gVGhlIGJhciBoZWlnaHQgdXN1YWxseSByZXByZXNlbnQgYSBtZWFuLCBhIGNvdW50LCBvciBhIHBlcmNlbnRhZ2UsIGJ5IGNhdGVnb3J5LiBUaGVzZSBjYW4gYmUgdXNlZnVsIGZvciBjb21wYXJpbmcgZ3JvdXBzIG9yIHNob3dpbmcgY2hhbmdlIG92ZXIgdGltZS4gDQoNCmBgYCB7ciwgZWNobyA9IEZBTFNFfQ0KZ2dwbG90KGpzX2RhdGEsIGFlcyh4PW1hcml0YWxTdGF0X2ZhY3QsIGZpbGwgPSBhcy5mYWN0b3IobWFyaXRhbFN0YXRfZmFjdCkpKSArDQogIGdlb21fYmFyKCkgKyANCiAgeGxhYigiTWFyaXRhbCBTdGF0dXMiKSArDQogIHlsYWIgKCJOdW1iZXIgb2YgUGFydGljaXBhbnRzIikgKw0KICBzY2FsZV9maWxsX2h1ZShjID0gNjApICsNCiAgdGhlbWUobGVnZW5kLnBvc2l0aW9uID0gIm5vbmUiLA0KICAgICAgICB0ZXh0ID0gZWxlbWVudF90ZXh0KHNpemUgPSAxOCksDQogICAgICAgIGF4aXMudGV4dC54ID0gZWxlbWVudF90ZXh0KGFuZ2xlID0gMzUsIGhqdXN0ID0gMSkpDQpgYGANCg0KIyMjIyAqKlNjYXR0ZXIgUGxvdCoqIA0KU2NhdHRlciBwbG90cyBpbmNsdWRlIGRhdGEgcG9pbnRzIHRoYXQgYXJlIHBsb3R0ZWQgYWxvbmcgYW4geCBhbmQgeSBheGlzLCBzaG93aW5nIHRoZSByZWxhdGlvbnNoaXAgYmV0d2VlbiB0aGVzZSB0d28gdmFyaWFibGVzLiBPZnRlbiByZXNlYXJjaGVycyBhZGQgYSBsaW5lIHRvIHRoZXNlIHBsb3RzIHRvIHNob3cgdGhlIHN0YXRpc3RpY2FsIHJlbGF0aW9uc2hpcCBiZXR3ZWVuIHRoZSB2YXJpYWJsZXMuIA0KDQpgYGB7ciwgZWNobyA9IEZBTFNFfQ0KZ2dwbG90KGpzX2RhdGEsIGFlcyhkdXJXb3JrLCBkdXJTbGVlcCkpICsNCiAgZ2VvbV9wb2ludChjb2xvciA9ICIjMkQ1RTdGIiwgYWxwaGEgPSAuMikgKw0KICBnZW9tX3Ntb290aChtZXRob2Q9bG0sIHNlPVRSVUUsIGNvbG9yID0gImJsYWNrIikgKw0KICB4bGFiKCJNaW51dGVzIFNwZW50IFdvcmtpbmciKSArDQogIHlsYWIgKCJNaW51dGVzIFNwZW50IFNsZWVwaW5nIikgKw0KICBsYWJzKHRpdGxlID0gIkFzc29jaWF0aW9uIEJldHdlZW4gV29ya2luZyBhbmQgU2xlZXBpbmciKSArDQogIHRoZW1lKHRleHQgPSBlbGVtZW50X3RleHQoc2l6ZSA9IDE4KSkNCmBgYA0KDQojIyMjICoqTGluZSBDaGFydCoqIA0KTGluZSBjaGFydHMgdXNlIGNvbm5lY3RlZCBzdHJhaWdodCBsaW5lcyB0byBkaXNwbGF5IGRhdGEuIFRoZXkgYXJlIGdvb2QgZm9yIHNob3dpbmcgY2hhbmdlIG92ZXIgdGltZSBvbiBhIGNvbnRpbnVvdXMgdmFyaWFibGUuIFRoZXkgYXJlIG9mdGVuIHNpbWlsYXIgaW4gcHVycG9zZSB0byBiYXIgY2hhcnRzLCBidXQgdmlzdWFsbHkgc2ltcGxlciBpZiB0aGVyZSBhcmUgbWFueSB0aW1lIHBvaW50cy4gQW4gZXhhbXBsZSBvZiB3aGVyZSB3ZSBvZnRlbiBzZWUgbGluZSBjaGFydHMgdXNlZCBpbiB0aGUgbmV3cyBpcyB0byB2aXN1YWxpemUgdGhlIHN0b2NrIG1hcmtldC4gKFBsb3R0aW5nIHRoZSB2YXJpb3VzIGFnZSBncm91cHMgaGVyZSBpcyBub3QgcGFydGljdWxhcmx5IG1lYW5pbmdmdWwgc2luY2UgdGhpcyBkYXRhIHdhcyBvbmx5IGNvbGxlY3RlZCBhdCBvbmUgdGltZSBwb2ludCwgYnV0IGlzIHVzZWQgdG8gaWxsdXN0cmF0ZSB0aGlzIHR5cGUgb2YgZGF0YSB2aXN1YWxpemF0aW9uLikNCg0KYGBge3IsIGVjaG8gPSBGQUxTRX0NCnhWYWx1ZSA8LSAxOjcNCnlWYWx1ZSA8LSBjKDEzMDMsIDIxMjcsIDI1OTcsIDI3ODksIDM3NDEsIDI5NTgsIDE4NzUpDQpwbG90ZGF0YSA8LSBkYXRhLmZyYW1lKHhWYWx1ZSx5VmFsdWUpDQoNCmdncGxvdChwbG90ZGF0YSwgYWVzKHg9eFZhbHVlLCB5PXlWYWx1ZSkpICsNCiAgZ2VvbV9saW5lKGNvbG9yID0gIiMyRDVFN0YiKSArDQogIHhsYWIoIkFnZSBHcm91cHMiKSArDQogIHlsYWIgKCJOdW1iZXIgb2YgUGFydGljaXBhbnRzIikgKw0KICBsYWJzKHRpdGxlID0gIk51bWJlciBvZiBQYXJ0aWNpcGFudHMgcGVyIEFnZSBHcm91cCIpICsNCiAgdGhlbWUodGV4dCA9IGVsZW1lbnRfdGV4dChzaXplID0gMTgpKSArDQogIHNjYWxlX3hfY29udGludW91cyhicmVha3MgPSBzZXEoMSwgNywgMSkpICsNCiAgc2NhbGVfeV9jb250aW51b3VzKGJyZWFrcyA9IHNlcSgwLCA0MDAwLCA1MDApKQ0KDQpgYGANCg0KIyMjIyAqKkludGVyYWN0aXZlIERhdGEgVmlzdWFsaXphdGlvbnMqKiANCkFzIHJlc2VhcmNoIGFuZCBwdWJsaWNhdGlvbnMgbW92ZSBtb3JlIG9ubGluZSBhbmQgYXdheSBmcm9tIHByaW50LCB0aGlzIGNhbiBhbGxvdyBmb3IgbW9yZSBpbnRlcmFjdGl2ZSBkYXRhIHZpc3VhbGl6YXRpb25zLiBUaGVzZSBhcmUgdHlwZXMgb2YgZGF0YSB2aXN1YWxpemF0aW9ucyB0aGF0IGFsbG93IGEgcGVyc29uIHRvIHNlbGVjdCBhbmQgY2hhbmdlIHdoYXQgaXMgYmVpbmcgc2hvd24uIENoZWNrIG91dCB0aGlzIGdyZWF0IGV4YW1wbGUgZnJvbSA8YSBocmVmPSJodHRwczovL3d3dy5nYXBtaW5kZXIub3JnL3Rvb2xzLyMkY2hhcnQtdHlwZT1idWJibGVzJnVybD12MikiPkdhcG1pbmRlcjwvYT4uIFRoZSBkZWZhdWx0IHZpc3VhbGl6YXRpb24gc2hvd3MgR0RQIGFuZCBsaWZlIGV4cGVjdGFuY3kgb3ZlciB0aW1lLCBhbmQgYnkgY291bnRyeS4gSG93ZXZlciwgeW91IGNhbiBjaGFuZ2UgdGhlIHZhcmlhYmxlcyBpbmNsdWRlZCB0byB2aWV3IG90aGVyIGRhdGEuIA0KDQojIyMjICoqU28gbWFueSBtb3JlISoqIA0KLSBIZWF0IE1hcA0KLSBTdGFja2VkIEJhciBvciBTdGFja2VkIEFyZWEgQ2hhcnQNCi0gVmlvbGluIFBsb3QNCi0gR2FudHQgQ2hhcnQNCi0gQ2hvcm9wbGV0aCBNYXANCg0KIyMjIFdoYXQgTWFrZXMgYSBHb29kIFZpc3VhbGl6YXRpb24/DQpUaGVyZSBpcyBhbiBhcnQgdG8gcGlja2luZyB0aGUgYmVzdCBkYXRhIHZpc3VhbGl6YXRpb24gdGhhdCBmaXRzIHlvdXIgZGF0YSBhbmQgdGhlIHN0b3J5IHlvdSBhcmUgdGVsbGluZy4gQnkgbmF0dXJlLCBkYXRhIHZpc3VhbGl6YXRpb25zIGFyZSBhYnN0cmFjdCByZXByZXNlbnRhdGlvbnMgb2Ygb3VyIGRhdGEsIHdpdGggY29sb3IsIHNoYXBlLCBhbmQgcG9zaXRpb24gcmVwcmVzZW50aW5nIHRoZSBkYXRhIHBvaW50cy4gVGhpcyBib3RoIGhpZGVzIHRoZSBleGFjdCBkYXRhIGl0c2VsZiwgd2hpbGUgYWxzbyBhbGxvd2luZyB1cyB0byBoaWdobGlnaHQgYmlnZ2VyIHBpY3R1cmUgaWRlYXMgYWJvdXQgdGhlIGRhdGEsIGRlcGVuZGluZyBvbiB3aGF0IHdlIGNob29zZSB0byBlbXBoYXNpemUuIFdoZW4gZGVjaWRpbmcgb24gd2hhdCB0eXBlIG9mIGRhdGEgdmlzdWFsaXphdGlvbiB0byB1c2UsIGNvbnNpZGVyIHRoZSBmb2xsb3dpbmc6IA0KDQotIFdoYXQgcXVlc3Rpb24gYXJlIHlvdSBleHBsb3Jpbmcgd2l0aCB5b3VyIGRhdGEgYW5kIGhvdyB3aWxsIGl0IGluZm9ybSBmdXR1cmUgYW5hbHlzZXM/DQotIFdoYXQgaXMgeW91ciBkYXRhIHZpc3VhbGl6YXRpb24gYWRkaW5nIHRvIHlvdXIgc2NpZW5jZSBjb21tdW5pY2F0aW9uPyANCi0gV2hhdCB0YWtlLWF3YXkgbWVzc2FnZSBhcmUgeW91IGNvbnZleWluZyB3aXRoIHRoZSBpbWFnZT8gDQotIFdoYXQgdHlwZSBvZiB2YXJpYWJsZXMgZG8geW91IGhhdmU/IENvbnRpbnVvdXM/IENhdGVnb3JpY2FsPyBBbmQgd2hhdCB0eXBlIG9mIGFic3RyYWN0aW9uIChlLmcuLCBjb2xvciwgc2hhcGUpIGJlc3Qgc3VpdHMgdGhhdCB2YXJpYWJsZT8NCi0gQXJlIHlvdSBjb21wYXJpbmcgZ3JvdXBzPw0KLSBBcmUgeW91IHNob3dpbmcgY2hhbmdlIG92ZXIgdGltZT8NCi0gQXJlIHlvdSB2aXN1YWxpemluZyBhIHJlbGF0aW9uc2hpcCBiZXR3ZWVuIHZhcmlhYmxlcz8NCg0KSXQgY2FuIGJlIGVhc3kgdG8gZ2V0IGluIHRoZSBoYWJpdCBvZiB1c2luZyB0aGUgc2FtZSB0eXBlcyBvZiBkYXRhIHZpc3VhbGl6YXRpb24gb3ZlciBhbmQgb3ZlciBhZ2Fpbi4gQ2hlY2sgb3V0IHRoaXMgd2Vic2l0ZSB0aGF0IGdpdmVzIG1hbnkgY3JlYXRpdmUgZGF0YSB2aXN1YWxpemF0aW9uIG9wdGlvbnMgKHdpdGggUiBjb2RlISksIGNhdGVnb3JpemVkIGJ5IGdvYWw6IDxhIGhyZWY9Imh0dHBzOi8vci1ncmFwaC1nYWxsZXJ5LmNvbS8gIj5odHRwczovL3ItZ3JhcGgtZ2FsbGVyeS5jb20vIDwvYT4NCg0KIyMjIyBHb29kIERhdGEgVmlzdWFsaXphdGlvbiBQcmluY2ljcGxlcw0KDQpPbmNlIHlvdSBwaWNrIHRoZSBmb3JtYXQgdGhhdCBmaXRzIHlvdXIgbmVlZHMgYmVzdCwgdGhlc2UgYXJlIHNvbWUgcHJpbmNpcGxlcyB0byBrZWVwIGluIG1pbmQgd2hlbiBjcmFmdGluZyB5b3VyIHZpc3VhbGl6YXRpb24gdG8gbWFrZSBzdXJlIGl0IGlzIGNsZWFyIHRvIHlvdXIgYXVkaWVuY2UuDQoNCjo6Om1kLXRhYmxlDQp8IFByaW5jaXBsZSB8IENvbnNpZGVyYXRpb25zIHwNCnwgOi0tLSB8IDotLS0gfA0KfCBDbGVhciBEYXRhIHwgQ29uc2lkZXIgdGhlIGZvcm1hdCBvZiB5b3VyIGRhdGEgd2hlbiB5b3UgaW5jbHVkZSBpdC4gWW91ciBkYXRhIG5lZWRzIHRvIGJlIHVuYW1iaWd1b3VzbHkgY29tbXVuaWNhdGVkIHRvIHlvdXIgYXVkaWVuY2UuIEZvciBpbnN0YW5jZSwgZG8geW91IGhhdmUgc28gbWFueSBncm91cHMgdGhhdCB0aGV5IGFyZSBkaWZmaWN1bHQgdG8gZGlmZmVyZW50aWF0ZT8gQXJlIHlvdXIgZGF0YSBwb2ludHMgc3RhY2tlZCBvbiB0aGUgc2FtZSBzcG90IHNvIHRoZSBhdWRpZW5jZSBjYW4ndCBzZWUgdGhlIGRlbnNpdHkgb2YgeW91ciBkYXRhIHBvaW50cz8gfA0KfCBDbGVhciBMYWJlbHMgfCBBbGwgZGF0YSB2aXN1YWxpemF0aW9ucyBuZWVkIGxhYmVscy4gVGhpcyBtYXkgYmUgdGhlIGF4aXMgb24gYSBzY2F0dGVyIHBsb3QsIGxlZ2VuZHMgZm9yIHlvdXIgYmFyIGdyYXBoLCBvciBwZXJjZW50YWdlcyBvbiB5b3VyIHBpZSBjaGFydC4gWW91IG11c3QgdGVsbCB0aGUgYXVkaWVuY2Ugd2hhdCB0aGV5IGFyZSBsb29raW5nIGF0LiBJZiBkaWZmZXJlbnQgY29sb3JzIGFyZSB1c2VkLCB0aGV5IHNob3VsZCByZXByZXNlbnQgc29tZSBhc3BlY3Qgb2YgdGhlIGRhdGEgYW5kIGJlIGNsZWFybHkgbGFiZWxlZC4gfA0KfCBDbGVhciBTY2FsZXMgfCBDbGVhciBhbmQgY29uc2lzdGVudCBzY2FsZXMgYXJlIGltcG9ydGFudCB0byBhdm9pZCBtaXNpbnRlcnByZXRhdGlvbiBvZiB5b3VyIGRhdGEgdmlzdWFsaXphdGlvbi4gQW4gYXhpcyBzaG91bGQgYmUgY2xlYXJseSBsYWJlbGVkIGFuZCBpbmNsdWRlIHRoZSBmdWxsIHNjYWxlIHJhbmdlLiBNYWtlIGl0IGNsZWFyIGlmIHRoZSBzY2FsZSBkb2VzIG5vdCBzdGFydCBhdCAwLiBTY2FsZXMgc2hvdWxkIGJlIGNvbnNpc3RlbnQgYWNyb3NzIHZpc3VhbGl6YXRpb25zIHRvIGFsbG93IGZvciBjb21wYXJpc29ucy4gfA0KfCBTaW1wbGljaXR5IHwgQWltIHRvIGhhdmUgdW5jbHV0dGVyZWQgZGF0YSB2aXN1YWxpemF0aW9ucy4gSXQgaXMgZWFzeSB0byBnZXQgZXhjaXRlZCBhYm91dCBhbGwgeW91IGNhbiBkbyBjcmVhdGl2ZWx5IGluIHRoZSB3b3JsZCBvZiBkYXRhIHZpc3VhbGl6YXRpb25zLCBidXQgc29tZXRpbWVzIGFkZGluZyB0b28gbXVjaCAoZS5nLiwgZXh0cmEgY29sb3JzLCBwaWN0dXJlcykgY2FuIGFjdHVhbGx5IG9ic2N1cmUgeW91ciBtYWluIG1lc3NhZ2UuIEF2b2lkIGV4dHJhIGluZm8gdGhhdCBkb2Vzbid0IGFkZCB0byB0aGUgc3RvcnkgeW91IGFyZSB0ZWxsaW5nLiB8DQp8IEFjY2Vzc2liaWxpdHkgfCBDb25zaWRlciBob3cgeW91ciBkYXRhIHZpc3VhbGl6YXRpb24gZGVzaWduIHdvdWxkIGJlIHZpZXdlZCBieSBhIHZhcmlldHkgb2YgcGVvcGxlLiBUZXh0IGZvbnQgYW5kIHNpemUgZm9yIGxlZ2VuZHMgYW5kIGF4aXMgbGFiZWxzIHNob3VsZCBiZSBjbGVhciBhbmQgbm90IHRvbyBzbWFsbC4gVHJ5IG5vdCB0byByZWx5IG9ubHkgb24gY29sb3IgdG8gZGlzdGluZ3Vpc2ggZ3JvdXBzIChlLmcuLCBsaW5lcyBjYW4gYmUgZGFzaGVkIG9yIGRvdHRlZCksIG9yIHBpY2sgY29sb3JzL2h1ZXMgdGhhdCBhcmUgZGlzdGluZ3Vpc2hhYmxlIGJ5IHBlb3BsZSB3aG8gYXJlIGNvbG9yYmxpbmQuIEluY2x1ZGUgYWx0ZXJuYXRpdmUgdGV4dCBkZXNjcmlwdGlvbnMgdGhhdCBjYW4gYmUgcmVhZCBhbG91ZCBieSBhIHNjcmVlbiByZWFkZXIuIHwNCjo6Og0KDQoNCkZvciBtb3JlIGluZm9ybWF0aW9uIG9uIGRlc2lnbiBwcmluY2lwbGVzIGFuZCB0aGUgdmlzdWFsIGhpZXJhcmNoeSBvZiBlbGVtZW50cywgY2hlY2sgb3V0IDxhIGhyZWY9Imh0dHBzOi8vd3d3LmludGVyYWN0aW9uLWRlc2lnbi5vcmcvbGl0ZXJhdHVyZS90b3BpY3MvdmlzdWFsLWhpZXJhcmNoeT9zcnNsdGlkPUFmbUJPb29VNzdYUGlWc1hTa0U3dDJHcUFheWFPeWgwVnhkd0dqM2JKYVAxUWozeGNjNUE0NEJXIj50aGlzIGFydGljbGU8L2E+LiBTaXplLCBjb2xvciwgY29udHJhc3QsIGFsaWdubWVudCwgcmVwZXRpdGlvbiwgcHJveGltaXR5LCB3aGl0ZXNwYWNlLCBhbmQgdGV4dHVyZSBjYW4gYWxsIGJlIHVzZWQgdG8gZHJhdyBmb2N1cyB0byBwYXJ0aWN1bGFyIHZpc3VhbCBlbGVtZW50cy4gDQoNCg0KIyMjIFlvdXIgVHVybiENCk9uZSBvZiB0aGUgYmVzdCB3YXlzIHRvIGdldCBpbnRvIGRhdGEgdmlzdWFsaXphdGlvbiBpcyB0byBnZXQgaW5zcGlyZWQgZnJvbSBzb21lIG9mIHRoZSBhbWF6aW5nIGRhdGEgdmlzdWFsaXphdGlvbnMgdGhhdCBhbHJlYWR5IGV4aXN0ISANCg0KV2UgaGF2ZSB0d28gd2Vic2l0ZXMgd2l0aCBhIHZhcmlldHkgb2YgZGF0YSB2aXN1YWxpemF0aW9uIGV4YW1wbGVzLiANCg0KLSA8YSBocmVmPSJodHRwczovL3ItZ3JhcGgtZ2FsbGVyeS5jb20vYmVzdC1yLWNoYXJ0LWV4YW1wbGVzIj5SIEdyYXBoIEdhbGxlcnk8L2E+DQpJbmNsdWRlcyBtYW55IGV4YW1wbGVzIG9mIGRhdGEgdmlzdWFsaXphdGlvbnMgY3JlYXRlZCBpbiBSLiBUaGVzZSBhbHNvIGluY2x1ZGUgdHV0b3JpYWxzL1IgQ29kZSB1c2VkIHRvIG1ha2UgdGhlbS4gVGhlc2UgZXhhbXBsZXMgZ28gYmV5b25kIHdoYXQgd2Ugd2lsbCBjb3ZlciBpbiB0aGlzIHdvcmtzaG9wLCBidXQgc2VydmUgYXMgZ3JlYXQgaW5zcGlyYXRpb24gZm9yIGhvdyBtdWNoIHlvdSBjYW4gZG8gaW4gUiENCg0KLSA8YSBocmVmPSJodHRwczovL3d3dy50YWJsZWF1LmNvbS92aXotZ2FsbGVyeSI+VGFibGVhdSBWaXogR2FsbGVyeTwvYT4NCkluY2x1ZGVzIGV4YW1wbGVzIGNyZWF0ZWQgd2l0aCB0aGUgcGxhdGZvcm0gVGFibGVhdS4gVGhpcyBpcyBhIHByb3ByaWV0YXJ5IChwYWlkKSBwbGF0Zm9ybSB3aGljaCB3ZSBhcmUgbm90IHVzaW5nIGluIHRoaXMgd29ya3Nob3AsIGJ1dCB0aGlzIGdhbGxlcnkgc3RpbGwgaGFzIHNvbWUgZ3JlYXQgZXhhbXBsZXMgdG8gaGVscCBpbnNwaXJlIHlvdXIgZGF0YSB2aXN1YWxpemF0aW9uIGNyZWF0aXZpdHkhIA0KDQo6OjpxdWVzdGlvbg0KSW4gc21hbGwgZ3JvdXBzLCBvbiBlaXRoZXIgb2YgdGhlc2Ugd2Vic2l0ZXMsIGZpbmQgYSBkYXRhIHZpc3VhbGl6YXRpb24gZXhhbXBsZSB0aGF0IGp1bXBzIG91dCB0byB5b3UgYXMgaW50ZXJlc3RpbmcgYW5kIHRoZW4gYW5zd2VyIHRoZSBmb2xsb3dpbmcgcXVlc3Rpb25zLiANCg0KMS4gV2hhdCBjYXB0dXJlZCB5b3VyIGF0dGVudGlvbiBhYm91dCB0aGlzIGRhdGEgdmlzdWFsaXphdGlvbj8gVGhlIHRvcGljPyBUaGUgZGVzaWduPyANCjIuIFdoYXQgaXMgdGhlIHN0b3J5IHRoaXMgZXhhbXBsZSBpcyB0cnlpbmcgdG8gdGVsbD8gV2hhdCBpcyBvbmUgb2YgdGhlIHRha2UtYXdheSBtZXNzYWdlcyBpdCBpcyBjb252ZXlpbmc/DQozLiBXaGF0IGRvIHlvdSBsaWtlIGFib3V0IHRoaXMgdmlzdWFsaXphdGlvbj8gRG9lcyBpdCBjb252ZXkgaW5mb3JtYXRpb24gYWJvdXQgdGhlIGRhdGEgaW4gYSB1bmlxdWVseSBlZmZlY3RpdmUgd2F5PyBEb2VzIGl0IGFkaGVyZSB0byB0aGUgcHJpbmNpcGxlcyB3ZSBkaXNjdXNzZWQ/IA0KNC4gSXMgdGhlcmUgYW55dGhpbmcgeW91IGZpbmQgY29uZnVzaW5nIGFib3V0IHRoaXMgZXhhbXBsZT8gQW55dGhpbmcgeW91IHRoaW5rIGlzIG1pc3Npbmcgb3IgdGhhdCB5b3Ugd291bGQgY2hhbmdlIHRvIGltcHJvdmUgaXQ/IA0KOjo6DQo=