Splunk-8 0 8-SearchTutorial
Splunk-8 0 8-SearchTutorial
Splunk-8 0 8-SearchTutorial
Additional resources........................................................................................................................................................102
Additional resources..............................................................................................................................................102
i
Introduction
Use this tutorial to learn how to use the Search app. Differences between Splunk Enterprise and Splunk Cloud are
specified throughout this tutorial.
You might see minor differences between the screen shots in this tutorial and the screens in your Splunk software
deployment. Some of the screen shots might show a previous version of the Search app, but these minor differences
will not impact your successful completion of the tutorial.
For this tutorial, use a free Trial version of the Splunk software.
Why? Because this tutorial uses a specific set of data to ensure consistency in your search results and the features that
you are learning about. In the tutorial, you will upload this tutorial-specific data to the Splunk platform. You might not have
permission to upload data in your production, work environment. Additionally, using a free Trial version of the software
ensures that the tutorial data is not mixed in with your work data.
The Trial version of the software converts to a Free version after 30 days. If you have a Free version of the Splunk
software, some of the features, such as changing Preferences in the User account menu, are not available. See About
Splunk Free in the Admin manual.
The steps for downloading a free Trial version of Splunk Enterprise or Splunk Cloud are described in the tutorial.
You will learn how to use the Search app to add data to your Splunk deployment, search the data, save the searches as
reports, and create dashboards. If you are new to the Search app, this tutorial is the place to start.
Each Part in the Search Tutorial builds on the previous Part. For example, the searches that you create in Part 5 are used
to create reports and charts in Part 7. It is important that you don't skip any Part.
1
Using the PDF version of the tutorial
You can copy and paste search strings or regular expressions directly into the Search & Reporting App from this online
tutorial in your web browser.
Do not copy and paste search strings or regular expressions directly from the electronic PDF into the Search app. Pasting
data from the PDF can cause errors in searches, because of hidden characters that are included in the PDF formatting.
At the end of most of the topics in this tutorial is a section called See also. These sections contain links to Splunk
documentation that is related to the information discussed in that topic.
Additional resources
See Additional resources at the end of this tutorial for information about:
Next step
2
Part 1: Getting started
You need a splunk.com account to download the free Trial version of the Splunk software. Creating an account is free. If
you do not already have a Splunk.com account, you need to create an account. If you already have an account, you need
to log in to that account.
Choose a platform
You can use this tutorial with a Trial version of Splunk Cloud or Splunk Enterprise. The main difference in the Trial
versions is the length of the license.
Splunk Cloud
When you start a Splunk Cloud Trial, you have access to Splunk Cloud for 15 days. The Trial license includes all
of the features in Splunk Cloud, and access to select premium applications and add-ons. You can index up to
5GB of data each day.
Splunk Enterprise
When you download Splunk Enterprise for the first time, you get a Splunk Enterprise Trial license for 60 days.
This trial license includes all of the features in Splunk Enterprise, and access to all premium applications and
add-ons. You can index up to 500MB of data each day.
After 60 days, the Enterprise Trial license converts to a perpetual Free license and some of the features, such as
user preferences, authentication, and alerting are disabled. The Free license also includes the 500MB daily
indexing volume, but there is no expiration date. See About Splunk Free in the Admin manual.
System requirements
Ensure that your computer meets the system requirements for your chosen platform.
3
Splunk Cloud
You must have a web browser. The latest versions of Chrome, Firefox, and Safari browsers are supported with
Splunk Cloud.
Splunk Enterprise
You can use Splunk Enterprise on Linux, Windows, or macOS. For this tutorial, your computer must meet the
specifications listed in the following table.
Web browser The latest versions of Chrome, Firefox, and Safari browsers are supported.
This tutorial uses a fictitious game store, called Buttercup Games, that sells games and related items in an online store.
You must download several data files to use with the tutorial. The data files contain web access log files, secure formatted
log files, sales log files, and a price list in a CSV file.
If you use the Safari browser, under Preferences > General, ensure that the Open "safe" files after downloading option
is unchecked. The tutorialdata.zip file must be compressed to upload the file successfully.
If you downloaded the Splunk Enterprise Trial software previously, download the Trial software again. It is possible that
your Splunk Enterprise Trial license converted to a Free license. The Free license has some limitations that will not
allow you to complete all parts of this tutorial.
1. Go back to the tab in your browser for the Splunk web site, https://www.splunk.com/.
2. In the upper right corner of the window, click Free Splunk.
3. Choose the platform you want to use and click on the link to download the Trial software.
Splunk Cloud
4
4. Accept the Terms of Service. Splunk Cloud should open in a browser window.
5. See Next step.
Splunk Enterprise
1. Identify the installer that you want to use with the tutorial.
Operating
For this tutorial Available installers
system
Use the MSI file graphical installer that is 2 installers. An MSI file for 64-bit and an MSI file for
Windows
appropriate for you computer. 32-bit.
Use the file that is appropriate for your Linux 3 installers. A RPM package, a DEB package, and a
Linux
distribution. compressed TAR (.tgz) file.
Next step
The next step depends on the Splunk platform that you are using.
Splunk Cloud
Splunk Web should launch automatically. The email you receive about your Splunk Cloud Trial contains the
username and password that you can use to access Splunk Cloud. The default username is sc_admin.
If you see a window welcoming you to the Splunk Cloud Trial and inviting you to Drop your data file here, close
that window. You will upload the tutorial data In Part 2. For now, go to Navigating Splunk Web.
Splunk Enterprise
See also
These steps apply only to Splunk Enterprise. If you're using Splunk Cloud, go to Navigating Splunk Web.
5
• macOS installation instructions
For other installers or other supported operating systems, see the step-by-step installation instructions for those platforms.
After installing Splunk Enterprise, you can continue to Navigating Splunk Web.
Splunk Enterprise provides three Linux installer options: an RPM, a DEB, or a .tgz file.
Prerequisite
You must have access to a command-line interface (CLI). When you type in the installation commands, replace
splunk_package_name with the file name of the Splunk Enterprise installer that you downloaded.
You can install the Splunk Enterprise RPM in the default directory /opt/splunk, or in a different directory.
• You can install the Splunk Enterprise DEB only into the /opt/splunk directory.
• This location must be a regular directory, and cannot be a symbolic link.
• You must have access to the root user or have sudo permissions to install the package.
• The package does not create environment variables to access the Splunk Enterprise installation directory. You
must set those variables on your own.
If you need to install Splunk Enterprise somewhere else, or if you use a symbolic link for /opt/splunk, then use a TAR file
to install the software.
Knowing the following items helps ensure a successful installation with a compressed TAR file:
• Some non-GNU versions of tar might not have the -C argument available. In this case, to install in /opt/splunk,
either cd to /opt or place the tar file in /opt before you run the tar command. This method works for any
accessible directory on your host file system.
• Splunk Enterprise does not create the splunk user. If you want Splunk Enterprise to run as a specific user, you
must create the user manually before you install.
• Confirm that the disk partition has enough space to hold the uncompressed volume of the data you plan to keep
indexed.
1. To install Splunk Enterprise on a Linux system, expand the TAR file into an appropriate directory using the tar
command. The default installation directory is splunk in the current working directory.
6
To install into /opt/splunk, use the following command with the -C argument.
For this tutorial you will install Splunk Enterprise using the default installation settings, which run the software as the Local
System user, admin.
For other user options or to perform a custom installation, see the instructions for Install on Windows in the Installation
Manual.
7
The installer places a shortcut on the Desktop so that you can launch Splunk Enterprise from your Desktop any
time.
13. Go to the steps to Launch Splunk Web.
Next step
See also
These steps apply only to Splunk Enterprise. If you're using Splunk Cloud, go to Navigating Splunk Web.
After you download and install the software, you must start Splunk Enterprise and launch Splunk Web. Splunk Web is the
user interface for Splunk Enterprise that you access using a Web browser.
After you install Splunk Enterprise, use the Splunk CLI to start Splunk Enterprise.
Prerequisite
You need to understand how to access the CLI. See About the CLI in the Admin Manual.
Steps
1. Use the Splunk Enterprise command-line interface (CLI)/code> and navigate to the bin directory:
cd <Splunk_Enterprise_Installation_Directory>/bin
./splunk start
2. You are prompted to create the Splunk Enterprise admin username. This is the username that you use to log into
Splunk Enterprise with, not the username that you use to log into your computer or into splunk.com. You can
press Enter to use the default username of admin.
8
Please enter a new password:
4. If the default management and Splunk Web ports are already in use (or are otherwise not available), Splunk
Enterprise offers to use the next available ports. You can either accept this option or specify a port to use.
5. Optional. You can set the SPLUNK_HOME environment variable to the Splunk Enterprise installation directory. Setting
the environment variable lets you refer to the installation directory later without having to remember its exact
location:
export SPLUNK_HOME=<Splunk_Enterprise_Installation_Directory>
cd $SPLUNK_HOME/bin
6. Start Splunk Enterprise.
./splunk start
7. Accept the Splunk Enterprise license.
After you run the start command, Splunk Enterprise displays the license agreement and prompts you to accept
the license before the startup sequence continues.
If you have problems starting Splunk Enterprise, see Start Splunk Enterprise for the first time in the Installation
Manual.
8. Now login to Splunk Web.
If you need to stop, restart, or check the status of your Splunk Enterprise server, use these CLI commands:
$ splunk stop
$ splunk restart
$ splunk status
Start Splunk Enterprise on Windows
After the Windows installation finishes, Splunk Enterprise starts and opens Splunk Web in your Web browser.
If Splunk Enterprise does not start, use one of the following options to start it.
9
Login to Splunk Web
Splunk Web runs by default on port 8000 of the host on which it is installed. If you use Splunk Enterprise on your local
machine, the URL to access Splunk Web is http://localhost:8000.
When you launch Splunk Enterprise for the first time, this login screen appears.
1. Login using the username and the password that you specified when you installed Splunk Enterprise.
2. The Help us improve Splunk software window appears. Read each of the types of usage collection and click
OK or Skip.
Next step
You have downloaded the tutorial data files and installed Splunk Enterprise.
Splunk Web is the primary interface for searching, problem investigation, reporting on results, and administrating Splunk
deployments.
Splunk Home is the initial page in Splunk Web. Splunk Home is an interactive portal to the data and applications that you
can access from your Splunk instance. The main parts of the Splunk Home page are the Apps panel, the Explore Splunk
panel, and the Splunk bar.
The following screen image shows the Splunk Home page for Splunk Enterprise. Splunk Cloud has a similar Home Page.
10
Apps panel
The Apps panel lists the applications that are installed on your Splunk instance. The list shows only the apps that you
have permission to view.
When you first open Splunk Web, you see Search & Reporting in the Apps panel. The Search & Reporting app is
sometimes referred to as simply the Search app. There might be other apps listed on the Apps panel if other applications
are installed on your computer.
The Explore Splunk panel contains links to pages where you can get help.
Splunk Cloud
You can take a product tour or access the documentation that is used the most.
Splunk Enterprise
You can take a product tour, add data, browse for new apps, or access the documentation.
Splunk bar
The Splunk bar appears on every page in Splunk Web. You use this bar to switch between apps, configure your Splunk
deployment, view system-level messages, and monitor the progress of search jobs.
1. On the Splunk Home page, click Search & Reporting in the Apps Panel to open the Search app.
When you are in an app, the Applications menu displays in the Splunk bar. You can use the Applications menu to
switch between apps.
Splunk Cloud
The following image shows Splunk bar in Splunk Cloud.
11
Splunk Enterprise
The following image shows the Splunk bar in Splunk Enterprise.
We will explore the Search app in detail. For now, let's return to Splunk Home.
2. Click the Splunk logo on the Splunk bar.
Regardless of where you are in an app, you can always click the Splunk logo to return to Splunk Home.
In addition to the Applications menu, the Splunk bar has several other menus. Let's explore a few of them.
Account menu
Use the Account menu to edit your account settings, set your preferences, and to logout.
Splunk Cloud
The Account menu displays your name.
2. The Full name field should list your first name and surname.
You can change the order of the names, or type a nickname. For this tutorial, we will not change the other
settings.
3. Click Save.
4. Click the Splunk logo to return to Splunk Home.
Splunk Enterprise
The Account menu displays Administrator for now, but this menu is your Account menu. It shows
Administrator initially, because that is the default user name for a new installation.
12
1. Select Administrator > Account Settings.
2. In the Full name field, type your first name and surname.
For this tutorial, you will not change the other settings.
3. Click Save.
4. Click the Splunk logo to return to Splunk Home.
Messages menu
All system-level error messages are listed on the Messages menu. When you have a new message to review, a
numerical notification appears next to the Messages menu. The notification indicates the number of messages that you
have.
Assistance
The menu that you use to get help with the Splunk software depends on the Splunk platform that you are using.
Splunk Cloud
The Support & Services menu contains a set of links to Splunk Answers, the Documentation home page, and
the Splunk Support and Services page. You can also search the online documentation.
Splunk Enterprise
The Help menu contains a set of links to the product release notes, tutorials, Splunk Answers, and the Splunk
Support and Services page. You can also search the online documentation.
You will explore the other menus on the Splunk bar later in this tutorial.
Next step
You are now familiar with Splunk Web. Continue to Part 2: Uploading the tutorial data.
13
Part 2: Uploading the tutorial data
The Splunk platform accepts any type of data. In particular, it works with all IT streaming and historical data. The source
of the data can be event logs, web logs, live application logs, network feeds, system metrics, change monitoring, message
queues, archive files, and so on.
Network events The Splunk software can index remote data from any network port and SNMP events from remote devices.
Cloud services Data from Cloud services, such as AWS and Kinesis.
Database services Data from databases such as Oracle, MySQL, and Microsoft SQL Server.
Security services Data from security services such as McAfee, Microsoft Active Directory, and Symantec Endpoint Protection.
Virtualization
Data from virtualization services such as VMWare and XenApp.
services
Application
Data from application servers such as JMX & JMS, WebLogic, and WebSphere.
servers
The Windows version of Splunk software accepts a wide range of Windows-specific inputs, including Windows Event Log,
Windows sources
Windows Registry, WMI, Active Directory, and Performance monitoring.
Other input sources are supported, such as FIFO queues and scripted inputs for getting data from APIs, and other remote
Other sources
data interfaces.
For many types of data, you can add the data directly to your Splunk deployment. Many common data sources are
automatically recognized.
If the data that you want to use is not automatically recognized by the Splunk software, you need to provide information
about the data before you can add it.
The process of transforming the data is called indexing. During indexing, the incoming data is processed to enable fast
searching and analysis. The processed results are stored in the index as events.
The index is a flat file repository for the data. For this tutorial, the index resides on the computer where you access your
Splunk deployment.
14
Events are stored in the index as a group of files that fall into two categories:
• Raw data, which is the data that you add to the Splunk deployment. The raw data is stored in a compressed
format.
• Index files, which include some metadata files that point to the raw data.
These files reside in sets of directories, called buckets, that are organized by age.
By default, all of your data is put into a single, preconfigured index called main. You can create indexes to store your data
when you add the data to your Splunk instance. There are also several other indexes used for internal purposes.
Next step
Now that you are more familiar with data sources and indexes, let's learn about the tutorial data that you will work with.
See also
The information includes access.log files, secure.log files, and vendor_sales.log files from mail servers and web accounts.
The raw data in the access.log file is difficult to read and analyze when you have hundreds, if not thousands, of lines of
data. Each day, every day. That is where the Splunk platform comes in.
Thu Mar 22 2021 00:15:06 mailsv1 sshd[60445]: pam_unix(sshd:session): session opened for user mdubios by
(uid=0)
Thu Mar 22 2021 00:15:06 mailsv1 sshd[3759]: Failed password for djohnson from 194.8.74.23 port 3769 ssh2
Thu Mar 22 2021 00:15:08 mailsv1 sshd[5276]: Failed password for invalid user appserver from 194.8.74.23
port 3351
15
vendor_sales.log file data
Next step
Prerequisites
3. At the bottom of the window, click Upload. There are other options for adding data, but for this tutorial you will
upload the data files.
16
4. Under Select Source, click Select File..
17
5. In your download directory, select the tutorialdata.zip file and click Open.
Because you specified a compressed file, the Splunk software recognizes that type of data source. The Set
Source Type step in the Add Data wizard is skipped. When you load data that is not in a compressed file, you
will be asked to set the data source type.
6. Click Next to continue to Input Settings.
7. Under Input Settings, you can override the default settings for Host, Source type, and Index.
Because this tutorial uses a ZIP file, you are going to modify the Host setting to assign the host values by using a
portion of the path name for the files included in the ZIP file. The setting that you specify depends whether you
are using Splunk Cloud or Splunk Enterprise, and on the operating system that you are using.
Splunk Cloud
a. Select Segment in path.
b. Type 1 for the segment number.
Splunk Enterprise for Linux or Mac OS X
a. Select Segment in path.
b. Type 1 for the segment number.
18
Splunk Enterprise for Windows
a. Select Regular expression on path.
b. Type \\(.*)\/ for the regex to extract the host values from the path.
8. Click Review. The following screen appears where you can review your input settings.
19
10. To see the data in the Search app, click Start Searching.
You might see a screen asking if you want to take a tour. You can take the tour or click Skip.
The Search app opens and a search is automatically run on the tutorial data source.
Success! The results confirm that the data in the tutorialdata.zip file was indexed and that events were
created.
Next step
Now you know how to add data to your Splunk platform. Next, you will begin to learn how to search that data. Continue to
Part 3: Using the Splunk Search App.
20
Part 3: Using the Splunk Search App
1. If you are not on the Splunk Home page, click the Splunk logo on the Splunk bar to go to Splunk Home.
2. From Splunk Home, click Search & Reporting in the Apps panel.
The Search Summary view includes common elements that you see on other views, including the Applications menu, the
Splunk bar, the Apps bar, the Search bar, and the Time Range Picker. Elements that are unique to the Search Summary
view are the panels below the Search bar: the How to Search panel and the Search History panel.
The Search Summary view in Splunk Cloud and Splunk Enterprise are almost identical.
The following image shows the Search Summary view in Splunk Cloud.
21
Number Element Description
Applications menu Switch between Splunk applications that you have installed. The current application, Search &
1 Reporting app, is listed. This menu is on the Splunk bar.
Splunk bar Edit your Splunk configuration, view system-level messages, and get help on using the
2 product.
Apps bar Navigate between the different views in the application you are in. For the Search & Reporting
3 app the views are: Search, Analytics, Datasets, Reports, Alerts, and Dashboards.
Time range picker Specify the time period for the search, such as the last 30 minutes or yesterday. The default is
5 Last 24 hours.
6 How to search Contains links to the Search Manual and the Search Tutorial.
Workload management Specify which pool to run your search in or to use a policy-based pool. The
7
(Splunk Cloud only) policies are defined in the Workload Management app.
Search history View a list of the searches that you have run. The search history appears after
8
you run your first search.
Splunk Enterprise
In Splunk Enterprise there is an additional panel called What to search, which shows a summary of the data that
is uploaded to this Splunk instance and that you are authorized to view.
Some of the elements in this view might be familiar, such as the Apps bar, the Search bar, and the time range picker.
Below the Search bar, are the Timeline, the Fields sidebar, and the Events view.
The New Search view in Splunk Cloud and Splunk Enterprise are almost identical.
The following image shows the New Search view in Splunk Enterprise.
22
Number Element Description
Apps bar Navigate between the different views in the Search & Reporting app: Search, Analytics, Datasets, Reports, Alerts,
1 and Dashboards.
Time range
3 Specify the time period for the search.
picker
Search Actions that you can perform, including working with your search Job, sharing, printing, and
4 action exporting your search results.
buttons
Search The tab that your search results appear on depends on your search. Some searches produce
5 results tabs a set of events, which appear on the Events tab. Other searches transform the data in events
to produce search results, which appear on the Statistics tab.
Search Use the search mode selector to provide a search experience that fits your needs. The modes
6
mode menu are Smart (default), Fast, and Verbose.
Timeline A visual representation of the number of events that occur at each point in time. Peaks or
valleys in the timeline can indicate spikes in activity or server downtime. The timeline options
7
are located above the timeline. You can format the timescale, zoom out, or zoom to a selected
set of events.
Fields Displays a list of the fields discovered in the events. The fields are grouped into Selected
8
sidebar Fields and Interesting Fields.
9 Events Displays the events that match your search. By default, the most recent event is listed first. In
viewer each event, the matching search terms are highlighted. To change the event view, use the
23
Number Element Description
List, Format, and Per Page options.
Save As Use the Save As menu to save your search results as a Report, Dashboard Panel, Alert, or
10
menu Event Type.
Next step
See also
View and interact with your Search History in the Search Manual
Why source types matter in Getting Data In
You can use time ranges to troubleshoot an issue, if you know the approximate timeframe when the issue occurred.
Narrow the time range of your search to that timeframe. For example, to investigate an incident that occurred sometime in
the last hour, you can use the default time range Last 24 hours, but a better option is Last 60 minutes.
Let's explore the data from the Buttercup Games online store using the different time ranges.
buttercupgames
24
Notice that hundreds of events are returned.
You use the time range picker, which is to the right of the Search bar, to set time boundaries on your searches. The
default time range is Last 24 hours. You can restrict the search to one of the preset time ranges, or use a custom time
range.
When you run a search using the tutorial data, if no events are returned, it is probably because you downloaded the
tutorialdata.zip file more than one day ago. When you download the ZIP file, timestamps are generated at that moment
in time and are added to the data.
The tutorial data for the Buttercup Games store contains events for a seven day period. The dates of the events are
based on the date that you downloaded the tutorial data file. For example, if you download the file today, the dates for the
events begin the previous week. If today is a Wednesday, the events have a timestamp starting the previous Wednesday.
The last events are from yesterday. There are no events from today. Searching for events using Today or any time less
than the last 24 hours will return no events.
For all of your searches that use the tutorial data files, you need to adjust the search time range based on when you
downloaded the tutorial data files. If you downloaded the tutorial data file 3 days ago, there are no events from the last 3
days. Try a different Relative time range, such as Previous week or Last 7 days.
The time range picker has many preset time ranges that you can select from.
25
1. Click the time range picker to see a list of the time range options.
The Presets option contains Real-time, Relative, and Other time ranges.
♦ Real-time searches display a live, streaming view of events. You can specify a window over which to
retrieve events.
♦ Historical searches display events from the past. You can restrict your search by specifying a relative
time range or a specific date and time range.
Because the data for the Buttercup Games online store is a snapshot of historical data, you will not use the
'''Real-time''' preset time ranges in this tutorial.
The number of events returned should be larger. You changed the time range from Last 24 hours to
Yesterday.
Use a custom time range when one of the preset time ranges is not precise enough for your search.
You can use the Relative option to specify a custom time range.
26
3. For Earliest, type 2 in the field, and select Days Ago from the drop-down list.
4. For Latest, the default is Now. Select Beginning of today.
5. Click Apply.
The timestamps that appear below the radio buttons adjust based on your selections in the Relative list of time
ranges.
As mentioned before, if no events are returned, select a different time range, such 4 Days Ago or 1 Week Ago.
You can also use the Date Range and Date & Time Range options to specify a custom time range.
• Use Between to specify that events must occur between an earliest and latest date.
• Use Before to specify that events must occur before a date.
• Use Since to specify that events must occur after a date.
You use the Date Range option to specify dates. The following screen image shows the calendar that you can use to
select a date.
27
You use the Date & Time Range option when you want to specify both a date and a time. The following screen image
shows the "Between", "Before", or "Since" options.
For example, to troubleshoot an issue that took place April 16, 2019 about 10:05 AM, you can specify the earliest time of
04/16/2019 10:03:00.000 and the latest time of 04/16/2019 10:06:59.000 to show the events immediately before and after
the issue took place.
Next step
You have explored the Search app views and learned how important it is to specify time ranges with your searches.
Continue to Part 4: Searching the tutorial data.
See also
28
Part 4: Searching the tutorial data
The data for this tutorial is for the Buttercup Games online store. The store sells games and other related items, such as
t-shirts. In this tutorial, you will primarily search the Apache web access logs, and correlate the access logs with the
vendor sales logs.
Prerequisite
Complete the steps, Upload the tutorial data, in Part 2.
The Search Assistant is a feature in the Search app that appears as you type your search criteria. The Search Assistant is
like autocomplete, but so much more.
29
Matching Searches
The Search Assistant also returns matching searches, which are based on the searches that you have recently run. The
Matching Searches list is useful when you want to run the same search from yesterday, or a week ago. Your search
history is retained when you log out.
The Search Assistant is more useful after you start learning the search language. When you type search commands, the
Search Assistant displays command information.
Let's try to find out how many errors have occurred on the Buttercup Games website.
To retrieve events that mention errors or failures, you type the keywords in your search criteria. If you use multiple
keywords, you must specify Boolean operators such as AND, OR, and NOT.
For example, typing buttercupgames error is the same as typing buttercupgames AND error.
Tip: Instead of typing the search string, you can copy and paste the search from this tutorial directly into the
Search bar.
4. Click the Search icon to the right of the time range picker to run the search.
Notice that you must capitalize Boolean operators. The asterisk ( * ) character is used as a wildcard character to match
fail, failure, failed, failing, and so forth.
30
When evaluating Boolean expressions, precedence is given to terms inside parentheses. NOT clauses are evaluated
before OR clauses. AND clauses have the lowest precedence.
Below the Search bar are four tabs: Events, Patterns, Statistics, and Visualization.
The type of search commands that you use determines which tab the search results appear on. In the early parts of this
tutorial, you will work with the Events tab. Later in this tutorial, you will learn about the other tabs.
The Events tab displays the Timeline of events, the Display options, the Fields sidebar, and the Events viewer.
31
By default, the events appear as a list that is ordered starting with the most recent event. In each event, the matching
search terms are highlighted. The List display option shows the event information in three columns.
Column Description
Use the event information column to expand or collapse the display of the event information. By default the display is collapsed.
i Click the greater than ( > ) symbol to expand the display.
The timestamp for the event. When events are indexed, the timestamp in the event is extracted. If the event does not contain a
Time timestamp, the indexing process adds a timestamp that is the date and time the event was indexed.
Event The raw event data. The Selected fields from the Fields sidebar appear at the bottom of each event.
Change the display of the Events viewer
Timeline of events
The Timeline of events is a visual representation of the number of events that occur at each point in time. As the timeline
updates with your search results, there are clusters or patterns of bars. The height of each bar indicates the count of
events. Peaks or valleys in the timeline can indicate spikes in activity or server downtime. The timeline highlights patterns
of events, or peaks and lows in event activity. The timeline options are located above the timeline. You can zoom in, zoom
out, and change the scale of the timeline chart.
Fields sidebar
When you add data to the Splunk platform the data is indexed. As part of the index process, information is extracted from
your data and formatted as name and value pairs, called fields. When you run a search, the fields are identified and listed
in the Fields sidebar next to your search results. The fields are divided into two categories.
32
• Selected fields are visible in your search results. By default, host, source, and sourcetype appear. You can
select other fields to show in your events.
• Interesting fields are other fields that have been extracted from the events in your search results.
You can hide the fields sidebar to maximize the results area.
The Patterns tab displays a list of the most common patterns among the set of events returned by your search. Each of
these patterns represents events that share a similar structure.
The Statistics tab populates when you run a search with transforming commands such as stats, top, chart, and so on.
The keyword search for "buttercupgames" does not show results in this tab because the search does not include any
transforming commands.
Searches with transforming commands also populate the Visualization tab. The results area of the Visualizations tab
includes a chart and the statistics table that is used to generate the chart.
You will learn about transforming commands, and use the Statistics and Visualizations tabs, later in the tutorial.
Next step
See also
Help building searches using the Search Assistant in the Search Manual
Identify event patterns with the Patterns tab in the Search Manual
Fields exist in machine data in many forms. Often, a field is a value with a fixed, delimited position on a line, or a name
and value pair, where there is a single value to each field name. A field can be multivalued, that is, a field in a single event
can have multiple values in a field.
• Some examples of fields are clientip for IP addresses accessing your Web server, _time for the timestamp of an
event, and host for domain name of a server.
• One of the more common examples of multivalue fields is email address fields. While the From field will contain
only a single email address, the To and Cc fields have one or more email addresses associated with them.
Fields are searchable name and value pairings that distinguish one event from another. Not all events have the same
fields and field values. Use fields to write more tailored searches to retrieve the specific events that you want.
33
Extracted fields
The Splunk software extracts fields from event data at index time and at search time.
Index time
The time span from when the Splunk software receives new data to when the data is written to an index. During
index time, the data is parsed into segments and events. Default fields and timestamps are extracted, and
transforms are applied.
Search time
The period of time beginning when a search is launched and ending when the search finishes. During search
time, certain types of event processing take place, such as search time field extraction, field aliasing, source type
renaming, event type matching, and so on.
The default fields and other indexed fields are extracted for each event when your data is indexed.
When you search for fields, you use the syntax field_name=field_value.
• Field names are case sensitive, but field values are not.
• You can use wildcards in field values.
• Quotation marks are required when the field values include spaces.
1. Click Search in the App bar to start a new search. Notice that the time range is set back to the default Last 24
hours.
2. To search the sourcetype field for any values that begin with access_, run the following search.
sourcetype=access_*
This search indicates that you want to retrieve only events from your web access logs and nothing else.
This search uses a wildcard character in the field value, access_*, to match any Apache web access source type.
The source types can be access_common, access_combined, or access_combined_wcookie.
34
3. Scroll through the list of events in your search results.
If you are familiar with the access_combined format of Apache logs, you might recognize some of the information in each
event, such as:
35
These are events for the Buttercup Games online store, so you might recognize other information and keywords in the
search results, such as Arcade, Simulation, productId, categoryId, purchase, addtocart, and so on.
To the left of the events list is the Fields sidebar. As events are retrieved that match your search, the Fields sidebar
updates the Selected Fields and Interesting Fields lists. These are the fields that the Splunk software extracts from your
data.
When you first run a search the Selected Fields list contains the default fields host, source, and sourcetype. These
default fields appear in every event.
Interesting Fields are fields that appear in at least 20% of the events.
You can designate other fields to appear in the Selected Fields list. When you add a field to the Selected Fields list, the
field name and field value are included in the search results.
1. To add fields to the Selected Fields list, click All Fields at the top of the Fields sidebar.
The Select Fields dialog box shows a list of fields in your events. The # of Values column shows the number of
unique values for each field in the events. Because your search criteria specifies the source type, the sourcetype
field has just 1 value.
36
The list contains additional default fields, fields that are unique to the source type, and fields that are related to the
Buttercup Games online store.
♦ In addition to the three default fields that appear automatically in the list of Selected Fields, there are
other default fields that are created when your data is indexed. For example, fields that are based on the
event timestamp begin with date_*). The field that identifies data that contains punctuation is the punct
field. The field that specifies the location of the data in your Splunk deployment is the index field.
♦ Other field names apply to the web access logs that you are searching. For example, the clientip,
method, and status fields. These are not default fields. They are extracted at search time.
♦ Other extracted fields are related to the Buttercup Games online store. For example, the action and
categoryId fields.
2. Select the action, categoryId, and productId fields.
3. Close the Select Fields dialog box.
The three fields that you selected appear under Selected Fields in the Fields sidebar. The selected fields also appear in
the events in your search results, if those fields exist in that particular event. Every event might not have all of the selected
fields, as shown in the following image.
37
Identifying field values
The Fields sidebar displays the number of unique values for each field in the events. These are the same numbers that
appear in the Select Fields dialog box.
1. Under Selected Fields, notice the number 5 next to the action field.
2. Click the action field.
The field summary for the action field opens.
38
In this set of search results there are five values for action. The action field appears in over 50% of your search
results.
3. Close the action field summary window.
4. Review the other two fields you added to the Selected fields. The categoryId field identifies the types of games or
other products that are sold by the Buttercup Games online store. The productId field contains the catalog
numbers for each product.
5. Scroll through the events list.
6. The i column contains event information. In the i column, click the arrow ( > ) next to an event to expand the event
information.
You can use this expanded panel to view all the fields in a particular event, and select or deselect individual fields for an
individual event.
This search uses the HTTP status field, status, to specify successful requests and the action field to search only
for purchase events.
39
You can also search for failed purchases in a similar manner using status!=200, which looks for all events where
the HTTP status code is not equal to 200.
4. Change the status portion of the search to status!=200 and run the search again.
The way that errors are designed in events varies from source to source. To search for errors, your search must specify
these different designations.
Use Boolean operators to specify different error criteria. Use parenthesis to group parts of your search string.
Search for how many simulation style games were bought yesterday.
As you type the search, the Search Assistant shows you a list of your previous searches that start with
"sourcetype". You can select the search that you ran earlier to search for successful purchases. Then add
categoryId=simulation to the end of that search.
The count of events returned are the number of simulation games purchased.
3. Find the number of purchases for each type of product sold on the Buttercup Games online store.
1. Remove categoryId=simulation from your search criteria and run the search again.
2. Locate the unique categoryId values by clicking on the categoryId field in the Selected Fields list.
3. Click on a categoryId name, such as ACCESSORIES. The categoryId is added to your search and the
search is automatically run again. The results show the number of purchases for that product.
4. For the number of purchases made each day of the previous week, run the search again for each time range.
Next step
You can use your knowledge about fields to take advantage of the Splunk search processing language to generate
statistics and build charts.
40
Let's learn how to use the search language.
See also
About fields
Use default fields
When Splunk Enterprise extracts fields
For example, you ran the following search to determine how many simulation games were purchased:
To find this number for the days of the previous week, you need to run it against the data for each day of that week. To
see which products are more popular than the other, run the search for each of the eight categoryId values and compare
the results.
Splunk developed the Search Processing Language (SPL) to use with Splunk software. SPL encompasses all the search
commands and their functions, arguments, and clauses. One way to learn the SPL language is by using the Search
Assistant.
There are two modes for the Search Assistant: Compact and Full. The default mode is Compact, which you were
introduced to in the Basic searches and search results topic in this tutorial.
This section shows you how to change the Search Assistant mode. You will use the Search Assistant to learn about the
SPL and to construct searches. If you have a Splunk Free license, you will not be able to change the Search Assistant
mode. See Choose a platform to learn about difference between the Splunk Trial and Splunk Free licenses.
Splunk
Step Example
platform
41
Splunk
Step Example
platform
Let's explore the benefits of the Full mode and creating searches using the SPL commands.
Search.
4. Select the following search from the Matching Searches list, or type the search into the Search bar.
Notice that the Search Assistant changes to show a list of Common Next Commands.
42
You want the search to return the most popular items bought at the Buttercup Games online store.
6. Under Common Next Commands, select top.
The top command is appended to your search string.
♦ The search criteria before the pipe character, sourcetype=access_* status=200 action=purchase,
locates events from the access control log files, that were successful (HTTP status is 200), and that were
a purchase of a product.
♦ The search criteria after the pipe character, top categoryId, takes the events located and returns the
categoryId field for the most common values.
8. Run the search.
The results of the top command appear in the Statistics tab.
The top command is a transforming command. Transforming commands organize the search results into a table. Use
transforming commands to generate results that you can use to create visualizations such as column, line, area, and pie
43
charts. You will learn more about visualizations later in this tutorial.
Because transforming commands return your search results in a table format, the results appear on the Statistics tab.
In this search for successful purchases, seven different category IDs were found. The list shows the category ID values
from highest to lowest, based on the frequency of the category ID values in the events.
Many of the transforming commands return additional fields that contain useful statistical information. The top command
returns two new fields, count and percent.
• The count field specifies the number of times each value of the categoryId field occurs in the search results.
• The percent field specifies how large the count is compared to the total count.
You can also view the results of transforming searches on the Visualization tab, where you can format the chart type.
44
Column, Bar, and Pie charts are listed as the Recommended chart type for this data set.
45
4. Hover over each slice of the pie to see the count and percentage values for each categoryId.
46
5. Click on the STRATEGY slice.
categoryId=STRATEGY is added to your search string, replacing the top command. The search runs again.
Next step
See also
Use a subsearch
In this section you will learn how to correlate events by using subsearches.
A subsearch is a search that is used to narrow down the set of events that you search on. The result of the subsearch is
then used as an argument to the primary, or outer, search. Subsearches are enclosed in square brackets within a main
search and are evaluated first.
Let's find the single most frequent shopper on the Buttercup Games online store, and what that shopper has purchased.
The following examples show why a subsearch is useful. Example 1 shows how to find the most frequent shopper without
a subsearch. Example 2 shows how to find the most frequent shopper with a subsearch.
47
Example 1: Search without a subsearch
You want to find the single most frequent shopper on the Buttercup Games online store and what that shopper has
purchased. Use the top command to return the most frequent shopper.
The limit=1 argument specifies to return 1 value. The clientip argument specifies the field to return.
This search returns one clientip value, 87.194.216.51, which you will use to identify the VIP shopper. The
search also returns a count and a percent. These are the default fields that are returned with the top command.
4. You now need to run another search to determine how many different products the VIP shopper has purchased.
Use the stats command to count the purchases by this VIP customer.
This search uses several statistical functions with the stats command. An alias for the distinct_count() function
is dc().
48
This search uses the count() function to return the total count of the purchases for the VIP shopper. The dc()
function is the distinct_count function. Use this function to count the number of different, or unique, products that
the shopper bought. The values function is used to display the distinct product IDs as a multivalue field.
The drawback to this approach is that you have to run two searches each time you want to build this table. The top
purchaser is not likely to be the same person in every time range.
Let's start with our first requirement, to identify the single most frequent shopper on the Buttercup Games online store.
1. Copy and paste the following search into the Search bar and run the search. Make sure the time range is All
time.
This search returns the clientip for the most frequent shopper, clientip=87.194.216.51. This search is almost
identical to the search in Example 1 Step 1. The difference is the last piped command, | table clientip, which
displays the clientip information in a table. Because you specified only the clientip field with the table
command, that is the only field returned. The count and percent fields that the top command generated are
discarded from the output.
To find what this shopper has purchased, you run a search on the same data. You provide the result of the most
frequent shopper search as one of the criteria for the purchases search.
The most frequent shopper search becomes the subsearch for the purchases search. The purchases search is
referred to as the outer or primary search. Because you are searching the same data, the beginning of the outer
search is identical to the beginning of the subsearch.
A subsearch is enclosed in square brackets [ ] and processed first when the search criteria are parsed.
2. Copy and paste the following search into the Search bar and run the search.
Because the top command returns the count and percent fields, the table command is used to keep only the
clientip value.
49
These results should match the result of the two searches in Example 1, if you run it on the same time range. If
you change the time range, you might see different results because the top purchasing customer will be different.
The performance of this subsearch depends on how many distinct IP addresses match status=200 AND
action=purchase. If there are thousands of distinct IP addresses, the top command has to keep track of all of
those addresses before the top 1 is returned, impacting performance. By default, subsearches return a
maximum of 10,000 results and have a maximum runtime of 60 seconds. In large production environments, it is
possible that the subsearch in this example will timeout before it completes. The best option is to rewrite the
query to limit the number of events that the subsearch must process. Alternatively, you can increase the
maximum results and maximum runtime parameters.
Subsearches and long complex searches can be difficult to read. You can apply auto-formatting to the search
syntax to make the the search syntax easier to read in the Search bar. Use the following keyboard shortcut to
apply auto-formatting to a search.
You can make the information more understandable by renaming the columns.
Column Rename
50
count Total Purchased
51
4. Experiment with this search. What happens when you run the search over different time periods? What if you
wanted to find the top product sold and how many people bought it?
Next step
You have learned how to use fields, the Splunk search language, and subsearches to search your data. Continue to Part
5: Enriching events with lookups.
See also
52
Part 5: Enriching events with lookups
Lookup files contain data that does not change very often. This can include information about customers, products,
employees, equipment, and so forth. For this tutorial, you will use a CSV lookup file that contains product IDs, product
names, regular prices, sales prices, and product codes.
The remaining Parts in this tutorial depend on you completing the steps in this section. If you do not configure the field
lookups, the searches will not produce the correct results.
With the tutorial lookup file, you can match the codes or IDs in the Buttercup Games store events with the codes or IDs in
a lookup file. This matching is referred to as field lookups. After the field lookups are configured, you can add any of the
fields from the lookup file to your searches. The lookup files are sometimes referred to as lookup tables or lookup table
files.
The prices.csv file contains the product names, price, and code. For example:
53
The following screen shot shows the Settings menu in Splunk Cloud. The Splunk Enterprise Settings menu has similar
options.
The Lookups manager opens, where you can create new lookups or edit existing lookups.
You can view and edit existing lookups by clicking on the links in the Lookups manager. In the next few sections of this
tutorial, you will upload a lookup table file, create a lookup definition, and create an automatic lookup.
To use a lookup table file, you must upload the file to your Splunk platform.
1. In the Lookups manager, locate Lookup table files and click Add new.
You use the Add new view to upload the CSV file that you want to as a lookup table.
54
2. The Destination app field specifies which app you want to upload the lookup table file to. To upload the file in the
Search app, select search from the list if it is not already selected.
3. Under Upload a lookup file, click Choose File and browse for the prices.csv file.
4. Under Destination filename, type prices.csv.
This is the name that you will use when you create a lookup definition.
5. Click Save.
This uploads your lookup file to the Search app and displays the lookup table files list.
If the Splunk software does not recognize or cannot upload the file, you can take the following actions.
55
The other lookup table files in the list are included with the Splunk software.
When you upload a lookup table file, the default sharing setting is Private. To use the file with other applications or with
specific roles, you need to change the permissions to the file. For this tutorial, you are going to share the lookup table file
with all applications.
1. In the Lookup table files list, locate the prices.csv file at the bottom of the Path list.
2. In the Sharing column, notice that prices.csv is listed as Private.
3. To share the lookup table file, click Permissions.
4. In the Permissions dialog box, under Object should appear in, select All apps.
5. Click Save.
The Sharing setting for the prices.csv lookup table is set to Global.
It is not sufficient to share the lookup table file with an application. You must define the information in the lookup table file
and how that information relates to the fields in your events. This is called a lookup definition.
1. In the Lookup table file dialog box, select Lookups in the breadcrumbs to return to the Lookups manager.
56
2. For Lookup definitions, click Add New.
The Add new lookups definitions page opens, where you define the field lookup.
3. For the Destination app setting, make sure it is set to search to add the lookup definition to the Search app.
4. For Name, type prices_lookup.
5. For Type, select File-based.
A file-based lookup is typically a static table, such as a CSV file.
6. For Lookup file, select prices.csv, which is the name of the lookup table file that you created.
7. Leave the check boxes for Configure time-based lookup and Advanced options unchecked.
8. Click Save.
The prices_lookup is now defined as a file-based lookup.
57
Notice the Supported fields column in the Lookup Definitions page. The Splunk software automatically interprets
the first row in a CSV lookup table file as the field names, or column headings, for the lookup table.
Now that you have created the lookup definition, you need to specify in which apps you want to use the lookup table.
58
3. Click Save.
In the Lookup definitions page, prices_lookup now has Global permissions.
You can use this field lookup to add information from the lookup table file to your events. You use the field lookup by
specifying the lookup command in a search. Or, you can set the field lookup to run automatically.
Instead of using the lookup command in your search when you want to apply a field lookup to your events, you can set
the lookup to run automatically.
1. In the Lookup table file dialog box, select Lookups in the breadcrumbs to return to the Lookups manager.
2. In the Lookups manager, for Automatic lookups, click Add New.
This takes you to the Add new automatic lookups view, where you configure the lookup to run automatically.
59
3. For the Destination app setting, make sure it is set to search to add the automatic lookup to the Search app.
4. For Name, type autolookup_prices.
5. For Lookup table, select prices_lookup.
The other options are lookup table files that come with the product.
6. For Apply to, the value sourcetype is already selected. For named, type access_combined_wcookie.
The lookup input fields are the fields that the lookup table and the events have in common. The lookup input fields
are used to associate, or link, the fields from the lookup table file with fields in your events.
♦ The first text box specifies the field name in the lookup table file.
♦ The second text box specifies the field name in your events.
The lookup table file has a productId column that contains values that match the values in the productId field in
the events.
8. For Lookup output fields, specify the names of the fields from the lookup table file that you want to add to your
event data. You can specify different names.
The lookup table file has several fields. You will specify two of the fields in the lookup table to appear in your
events.
1. In the first text box, type product_name. This is the field in the prices.csv file that contains the descriptive
name for each productId.
2. In the second text box, after the equal sign, type productName. This is the name of the field that will
appear in your events for the descriptive name of the product.
3. Click Add another field to add another field after the first one.
4. Type price in the first text box. This is the field in the prices.csv file that contains the price for each
productId. Let's use the same name for the field that will appear in your events. Type price in the second
text box.
60
9. Keep Overwrite field values unchecked.
10. Click Save.
The Automatic lookup view appears and the lookup that you configured, autolookup_prices, is in the list. The full
name is access_combined_wcookie : LOOKUP-autolookup_prices.
Now that you have created the automatic lookup, you need to specify in which apps you want to use the lookup table.
61
Next step
You have setup the Search app to automatically retrieve information from your lookup table definition.
Now, you will search using those lookup definitions.
Because the prices_lookup is an automatic lookup, the fields from the lookup table will automatically appear in your
search results.
1. From the Automatic Lookups window, click the Apps menu in the Splunk bar.
2. Click Search & Reporting to return to the Search app.
3. Change the time range to All time.
4. Run the following search to locate all of the web access activity.
sourcetype=access_*
5. Scroll through the list of Interesting Fields in the Fields sidebar, and find the price field.
This field is added to your events from the automatic lookup you created.
6. Click price to open the summary dialog box for that field.
62
The summary dialog box contains a lot of information about the price field. For example, the price field appears in
more than 50% of the events. There are a set of built-in reports that you can access. Several aggregate
calculations, such as average, minimum, and standard deviation, are listed. Along with a count and percentage of
how many events each price appears in.
7. Next to Selected, click Yes. This moves the prices field from the list of Interesting Fields to the list of Selected
Fields in the Fields sidebar.
8. Close the dialog box.
9. Scroll through the list of Interesting Fields in the Fields sidebar, and find the productName field.
10. Click productName to open the summary dialog box for the field.
11. Next to Selected, click Yes.
12. Close the dialog box.
Both the price and the productName fields appear in the Selected Fields list and in the search results.
Notice that not every event shows the price and the productName fields.
When you setup the automatic lookup, you specified that the productId field in your indexed events corresponds to the
productId field in the prices.csv file.
When you run a search, the Splunk software uses that relationship to retrieve, or lookup, data from the prices.csv file.
This enables you to specify the productName and price fields in your search criteria. The product name and price
information does not exist in your indexed fields. This information exists in the lookup file, prices.csv.
You can show a list of the Buttercup Games product names and the corresponding prices by using the stats command to
output a table that lists the prices by product. The search also uses the AS keyword and the rename command.
63
1. Run the following search using the All time time range.
In Part 4 of this tutorial about subsearches, you created the following search that returned the product IDs of the products
that a VIP client purchased.
64
The events return the product IDs because that is the only data in your events about the product. However, now that you
have defined the automatic lookup, you can return the actual product names.
The results, like the previous search, show the purchases by the VIP customer. However, the results are
more meaningful because the product names, which are coming from the lookup table, appear instead of
the more cryptic product IDs.
65
Next step
You have learned how to use field lookups in your searches. As you run more searches, you want to be able to save
those searches, or share the searches with other people. Continue to Part 6: Creating reports and charts.
See also
66
Part 6: Creating reports and charts
The remaining Parts in this tutorial depend on you completing the steps in the section Enabling field lookups. If you do
not configure the field lookups, the searches will not produce the correct results.
Reports are created whenever you save a search. After you create a report, you can do a lot with it.
1. Set the time range to Last 7 days and run the following search.
This is the same search that you ran in the section Search with field lookups.
If your search does not return results, increase the time range of the search. For example, you can run this
search over the time range Last 30 days or All Time.
2. Above the Search bar, click Save as and select Report.
67
3. In the Save As Report dialog box for Title type VIP Customer.
4. For Description, type Buttercup Games most frequent shopper.
7. Click View.
The title and description that you specified appear at the top of the report. Time range picker is also included at
the top of the report. If you specified some other time range for the search, that time range appears in the report.
68
View and edit reports
You can view and edit reports that you have saved. You edit a report directly from within the report.
3. Look at the time range picker, located at the upper left corner of the window.
With the Time range picker, you can change the time period to run this search. For example, you can use the time
range picker to run this search for the VIP Customer Week to date, Last 60 minutes, or Last 24 hours just by
selecting the Preset time range or defining a custom time range.
69
Find and share reports
1. Click Reports to open the Reports page and view the list of reports.
70
When you save a report, Sharing is set to Private. Only you can view and edit the report. You can allow other
apps to view, edit, or both view and edit the report by changing the report permission.
2. For the VIP Customer report, under Actions click Edit.
3. Select Edit Permissions.
71
6. Click Save.
The Reports page appears. The Sharing setting for the VIP Customer report now reads App instead of Private.
Next step
Let's explore some other search examples, work with chart visualizations, and save the searches as reports, starting with
Create a basic chart.
See also
About reports
Accelerate reports
Prerequisite
This example requires the productName field from the Enabling field lookups section. You must complete all of those steps
before continuing with this section. If you do not configure the field lookups, the searches will not produce the correct
results.
Steps
72
3. Run the following search.
This search uses the chart command to count the number of events that are action=purchase and
action=addtocart. The search then uses the rename command to rename the fields that appear in the results.
The chart command is a transforming command. The results of the search appear on the Statistics tab.
73
4. Click the Visualization tab. The search results appear in a Pie chart.
5. Change the display to a Column chart.
Next step
See also
You will use the stats command to count the user actions. The eval command is used to calculate the conversion rates
for those actions. For example, how often someone who viewed a product also added the product to their cart.
This example uses the productName field from the Enabling field lookups section of this tutorial. If you do not configure
the field lookups, the searches in this section will not produce the correct results.
74
2. Change the time range to All time.
3. Run the following search.
The eval command is used to define two new fields. These fields contain the conversion rates.
♦ The viewToPurchases field calculates the number of customers who viewed the product to the number
of customers who purchased the product. The calculation returns a percentage.
♦ The cartToPurchases field calculates the number of customers who added the product to their cart to
the number of customers who purchased the product. The calculation returns a percentage.
75
4. Click the Visualization tab.
This is the same chart in the section Create a basic chart, with two additional data series, viewsToPurchases
and cartToPurchases.
The next few steps reformat the chart visualization to overlay the two data series for the conversion rates, onto the three
data series for the actions.
Notice that the labels on the X-Axis are truncated. Because there are so many products, the labels are truncated making
them difficult to read. Let's fix that.
76
3. Close the Format dialog box.
Notice the change in the labels on the X-Axis.
Look at the numbers on the Y-Axis. The numbers range from 1000 to 3000 and there is no title to identify what that axis
tracks. Let's make the chart easier to read,
5. Close the Format dialog box. Notice the changes to the label and values on the Y-Axis.
77
Format the second Y-Axis
Look at the legend. It shows that some of the columns represent actions such as Views and Purchases, and some
columns represent conversion rates such as viewsToPurchases. The actions are counts of the values in specific fields.
The conversion rates are percentages. These two types of information should be shown separately.
78
The axis on the right side of the chart is called a second Y-Axis. The label and values for the line series appear on this
axis.
You've made great changes to the chart to make it more readable. Now it's time to save the chart as a report.
2. In the Save Report As dialog box, for Title type Comparison of Actions and Conversion Rates by Product.
3. For Description, type The number of times a product is viewed, added to cart, and purchased and the
rates of purchases from these actions.
4. Click Save
5. In the confirmation dialog box, click View.
79
Next step
See also
This example uses the productName field from the Enabling field lookups section of this tutorial. If you do not configure
the field lookups, the searches in this section will not produce the correct results.
This search uses the count() function to count the number of events that have the field action=purchase.
The search also uses the usenull and useother arguments to ensure that the timechart command counts events
that have a value for productName Events that have null values for productName are not included.
80
4. Click the Visualization tab.
5. Change the chart type to a Line chart.
6. Use the Format drop-down to format the X-Axis, Y-Axis, and Legend to produce the following chart.
Y-Axis Interval 10
81
Next step
See also
For searches that use the stats and chart commands, you can add sparkline charts to the results table.
This example uses the productName field from the Enabling field lookups section of this tutorial. If you do not configure
the field lookups, the searches in this section will not produce the correct results.
82
This search uses the chart command to count the number of purchases by using action="purchase". The search
specifies the purchases made for each product by using categoryId. The difference is that the count of purchases
is now an argument of the sparkline() function.
When you rename a column using the AS keyword, names that are more than one word need to be in
quotation marks. In this search quotation marks are around the name Purchases Trend but not around the
name Category.
83
Next step
Up to now, you have saved searches as Reports. Continue to Part 7: Creating dashboards, where you learn how to save
searches and reports as dashboard panels.
See also
84
Part 7: Creating dashboards
About dashboards
Dashboards are views that are made up of panels. The panels can contain modules such as search boxes, fields, charts,
tables, and lists. Dashboard panels are usually connected to reports.
After you create a search visualization or save a report, you can add it to a new or existing dashboard. There is also a
Dashboard Editor that you can use to create and edit dashboards. The Dashboard Editor is useful when you have a set of
saved reports that you want to quickly add to a dashboard.
85
Change dashboard permissions
You can grant access to a dashboard from the Dashboard Editor. However, your user role and capabilities defined for that
role might limit the type of access you can define.
If your Splunk user role is admin (with the default set of capabilities), then you can create dashboards that are private,
visible in a specific app, or visible in all apps. You can also provide access to other Splunk user roles, such as user,
admin, and other roles with specific capabilities.
After you create a panel with the Dashboard Editor, use the Visualization Editor to change the visualization type in the
panel, and to specify how the visualization displays and behaves.
You can edit the panels in a dashboard by editing the XML configuration for the dashboard. This provides access to
features not available from the Dashboard Editor. For example, you can edit the XML configuration to change the name of
dashboard, or you can specify a custom number of rows in a table.
Next step
Now let's create dashboards and dashboard panels that are based on searches and reports.
See also
86
This search returns events from web server access log files for successful (status=200) purchases. The top
command automatically returns the count of purchases for each product and the percent each product is of the
total purchases.
87
6. Click Save As and select Dashboard Panel.
7. Define a new dashboard and dashboard panel.
1. For Dashboard, click New.
2. For Dashboard Title, type Buttercup Games - Purchases.
The Dashboard ID field displays buttercup_games__purchases.
3. For Dashboard Description, type Reports on Buttercup Games purchases data.
4. For Dashboard Permissions, keep the default setting Private.
5. For Panel Title, type Top Purchases by Category.
6. For Panel Content, keep the setting for Pie Chart.
8. Click Save.
9. In the confirmation dialog box, click View Dashboard.
88
You now have a dashboard with one report panel. To add more report panels, you can either run new searches and save
them to this dashboard, or you can add saved reports to this dashboard. You will add more panels to this dashboard in
the next section.
For now, let's spend a little bit more time on this dashboard panel.
There is a separate view to see a list of the dashboards that you have access to. From this view, you can create
dashboards, and make changes to dashboards and dashboard panels.
You might see a pop-up dialog box asking if you want to take a tour about dashboards. If you take the tour, there
is an option at the end of the tour to try dashboards yourself. This option displays the Dashboards view.
In addition to the Buttercup Games - Purchases dashboard that you created, there are several built-in
dashboards in the list.
2. For the Buttercup Games - Purchases dashboard, click the arrow ( > ) symbol in the i column to expand the
dashboard information.
You can see information about the app that this dashboard is associated with, whether or not the dashboard is
scheduled, and the dashboard permissions.
89
Add controls to a dashboard
You can add input controls, such as the Time range picker, to dashboard panels.
1. In the Dashboards list, click Buttercup Games - Purchases to display that dashboard.
2. Click Edit.
You can either edit the dashboard using the UI or the Source. With the UI option you can add panels and inputs to
the dashboard.
♦ You can use the Add Panel option is used to create a new panel, add a report as a panel, or clone from
an existing dashboard.
♦ You can use the Add Input option to choose from a list of controls to add to the dashboard, including
text, a checkbox, and a time range picker.
♦ You can use the Dark Theme option to change the background appearance of the dashboard. To enable
the theme change, you must Save and Refresh the dashboard.
With the Source option, you can edit the XML source for the panel directly. Editing the source directly is not
discussed in this tutorial.
90
3. Click Add Input, and select Time.
91
The Time range picker input control appears on the dashboard.
4. Click the Edit Input icon for the Time range picker. The icon looks like a pencil.
This opens a set of input controls. The Time input type is selected.
92
1. For Label, type Time range.
2. For Token, replace the default token namefield1. Type BG_Purchases_Time_Range.
The controls that you add to a dashboard have identifiers called input tokens. This step redefines the
name of the input token for the Time range picker. The default names for input tokens are field1, field2,
field3, and so on. You can change the input tokens when you add controls to your dashboard. Naming the
tokens makes it easier to understand which input you are working with. In this example you are using a
token name that includes the a short version of the dashboard title.
3. For Default, change the default time range to Previous week.
4. Click Apply.
The input controls that you add to a dashboard are independent from the dashboard panels. If you want the chart
on the panel to refresh when you change the time range, you need to connect the dashboard panel to the Time
range picker input control.
5. In the dashboard panel, click the Edit Search icon. The icon looks like a magnifying glass.
93
6. In the Edit Search dialog box, for Time range the default selection is Use time picker. Click to see the options.
You want to select Shared Time Picker (BG_Purchases_Time_Range).
7. Click Apply.
8. In the Edit Dashboard window, click Save to save the changes to the dashboard.
The panel is now connected to the Time range picker input control in the dashboard. This Time range picker is
referred to as the shared time picker. The inline search that powers the panel now uses the time range that is
specified in the shared time picker.
You can have dashboards that contain a mix of panels. Panels that are connected to the shared Time range picker,
and panels that show data for the time range specified in the search that the panel is based on. You will learn more
about connecting other panels to the shared time picker in the next section.
Next step
94
See also
Prerequisite
Ensure that you have the Buttercup Games - Purchases dashboard. This dashboard was created and edited in the
previous section of this tutorial, Create dashboards and panels. You must create that dashboard before continuing with
this section.
Steps
1. To display a list of your dashboards, click Dashboards on the Apps bar and select the Buttercup Games -
Purchases dashboard.
2. In the Actions column, click Edit and select Edit Panels. The Edit Dashboard page opens.
3. Click Add Panel.
The Add Panel sidebar menu opens on the right side of the window.
95
4. To add a new panel from an existing report, click New from Report.
The list expands to show reports that you created and saved and built-in reports.
96
5. Select Purchasing trends.
Next to the Add Panel sidebar, the Preview sidebar appears. The preview includes information about the report,
the search that the report is based on, and preview of the report itself. This is the sparkline chart report that you
created.
97
8. Close the Add Panel sidebar.
9. Rearrange the panels on the dashboard.
Drag and drop a panel by the panel drag and drop bar, which is at the top of the panel. When you drag a panel, a
four pointed arrow symbol appears on the drag and drop bar.
10. In the Edit Dashboards window, click Save to save your changes to the dashboard.
Your finished dashboard should look like the following image.
98
Adding a search to an existing dashboard
Prerequisite
This example requires the productName field from the Enabling field lookups section of this tutorial. You must complete all
of those steps before continuing with this section. If you do not configure the field lookups, the searches in this section will
not produce the correct results.
99
4. Click Save As and choose Dashboard panel.
5. For Dashboard, click Existing and select Buttercup Games - Purchases.
6. For Panel title, type VIP Client Purchases.
7. Click Save.
8. Click View Dashboard.
9. Click Edit.
10. In the dashboard editor, drag the VIP Client Purchases panel next to the Top Purchases by Category pie chart.
11. Click Save.
Your dashboard should look like the following image.
100
Connecting panels to a shared Time Range Picker
The type of panel that you add to a dashboard determines whether you can connect the panel to the shared Time Range
Picker.
The Buttercup Games - Purchases dashboard now contains the panels listed in the following table.
To connect the VIP Client Purchases panel to the shared Time Range Picker:
The VIP Client Purchases panel is now connected to the Time range picker input on the dashboard.
When you change the time range on the dashboard, the panels that are connected to the shared Time Range Picker are
updated. The searches that the panels are based on are run again to refresh the panels.
After you create a dashboard, use the buttons in the upper right corner to take actions on the dashboard, such as:
Next step
101
Additional resources
Additional resources
You can continue to use the tutorial data, run more searches, and create more dashboards.
Splunk Community
The Splunk Community is amazing and full of very active members who are supportive of new users. You can search for
solutions or ask questions on Splunk Answers, connect with helpful and fun Splunk enthusiasts through chat groups, or
meet users in your local area at User Groups near you. The Community portal has everything you need to discover how to
set yourself up for success with the Splunk Community.
Search resources
This tutorial was a brief introduction to navigating the search interface and using the search language. It walked you
through running some basic searches and saving the results as a report and dashboard, but you can do much more with
the Splunk software. For more details, see the following manuals:
• Search Manual: Explains how to search and use the Splunk Search Processing Language (SPLâ¢). Look here
for more thorough examples of writing Splunk searches to calculate statistics, evaluate fields, and report on
search results.
• Search Reference: Provides a reference for users who are looking for a catalog of the search commands with
complete syntax, descriptions, and examples for usage.
Splunk documentation
Splunk has a wide range of documentation, including tutorials, use cases, and manuals for administrators, developers,
and users, as well as SDK and SPL command syntax documentation.
There are separate manuals for searches, dashboards and visualizations, reports, metrics, and alerts. There is even a
manual for people who have inherited a Splunk deployment.
You will find all of the information on the Splunk Documentation site.
Quick References
102
Splunk Enterprise system requirements
The Search Tutorial presents a snapshot of the Splunk Enterprise system requirements. For an explanation of the
requirements, see System Requirements in the Installation Manual.
To learn more about the types of data you can add and using apps to index data, see Get started with getting data in in
the Getting data In manual.
Education
To learn more about Splunk features and how to use them, see the Splunk selection of Education videos and classes.
Send us feedback
At the bottom of every page of this tutorial, and all of the Splunk documentation, is a quick form that you can use to send
us feedback.
103