Xlconnect: A Platform-Independent Interface To Excel
Xlconnect: A Platform-Independent Interface To Excel
Contents
1 Introduction 1
1.1 Scope and purpose of this document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
1.2 Introduction to XLConnect . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
2 Installation 2
2.1 Software Requirements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
2.2 Package Installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
i
5 What’s new in XLConnect version 0.2-15 13
ii
1 Introduction
This document is a user manual for the XLConnect R package. It is meant to be a top-level introduction
and some of the more advanced features of XLConnect are not presented here. For such details, please
refer to the Reference Manual.
Examples
Any examples presented in this vignette can be found in the XLConnect.R script file, which you can find
in the top level library directory. You can also open the document by using the following command:
edit(file = system.file("XLConnect.R", package = "XLConnect"))
XLConnect is a package that allows for reading, writing and manipulating Microsoft Excel files from within
R. It uses the Apache POI API1 as the underlying interface.
XLConnect allows you to produce formatted Excel reports, including graphics, straight from within R.
This enables automation of manual formatting and reporting processes. Reading and writing named ranges
enables you to process complex inputs and outputs in an efficient way.
1 For more information on the Apache POI API, see the http://poi.apache.org/ webpage.
1
2 Installation
XLConnect is completely cross-platform and as such runs under Windows, Unix/Linux and Mac (32- and
64-bit). It does not require an installation of Microsoft Excel, or any special drivers.
All you need to use XLConnect are the following:
• R, version 2.10.0 or higher
• Java Runtime Environment (JRE), version 6 or higher
The XLConnect package is part of the Comprehensive R Archive Network (CRAN). It can be easily installed
by using the install.packages() command in your R session:
To load the package, use the library() or require() command in your R session:
library ( XLConnect )
The Reference Manual, containing help pages for each function within the package, can be opened by using
the help() command.
help ( XLConnect )
2
3.2 loadWorkbook() - loading/creating an Excel workbook
The loadWorkbook() function loads a Microsoft Excel workbook, so that it can then be further manipulated.
Setting the create argument to TRUE will ensure the file will be created, if it does not exist yet.
Both .xls and .xlsx file formats can be used.
createSheet() creates a sheet of a chosen name in the workbook specified as the object argument.
writeWorksheet() writes data into a worksheet (name or index specified as the sheet argument) of an
Excel workbook (object). The startRow and startCol are both 1 by default, meaning that if they are not
explicitly specified, the data will start being filled into the A1 cell of the worksheet.
createName() creates a name for a specified formula in a workbook. The overwrite argument lets you
define behaviour if the name already exists. If set to TRUE, the existing name will be removed before creating
a new one. If set to FALSE (default setting), an exception will be thrown.
3
3.3.4 writeNamedRegion() - writing named regions into an Excel workbook
writeNamedRegion() writes a named range into a workbook. The data is assumed to be a data.frame (or
list of data.frames, if multiple named regions are written with one call). The header argument allows you
to specify whether column names should be written.
saveWorkbook() saves a workbook to the corresponding Excel file and writes the file to disk.
4
Write data into an Excel named region
Let’s see how the basic functions introduced in this section can be used to create and save an Excel file. We
will use the ChickWeight dataset (built-in R dataset) for this simple example.
The code below first loads the ”XLConnectExample1.xlsx” workbook, using loadWorkbook(). If the work-
book does not exist yet, the function creates it (since the create argument is set to TRUE).
Then, via createSheet(), a sheet named ”chickSheet” is created within the workbook. We then use
writeWorksheet() to write the ChickWeight data frame into chickSheet.
At the end, we use saveWorkbook() to save the XLConnectExample1.xlsx file.
> require(XLConnect)
> wb <- loadWorkbook("XLConnectExample1.xlsx", create = TRUE)
> createSheet(wb, name = "chickSheet")
> writeWorksheet(wb, ChickWeight, sheet = "chickSheet", startRow = 3, startCol = 4)
> saveWorkbook(wb)
Please note that only at the point when we call saveWorkbook(), the Excel file is written to disk. All the
previous operations are performed in-memory, which has great performance advantages.
The four lines of code presented in the previous example can be replaced with a single call of the
writeWorksheetToFile() function:
> require(XLConnect)
> writeWorksheetToFile("XLConnectExample2.xlsx", data = ChickWeight,
+ sheet = "chickSheet", startRow = 3, startCol = 4)
5
writeWorksheetToFile() loads the workbook, creates the sheet and finally saves the workbook. When you
only need to write one sheet into an Excel file, this is probably the better choice. If you need to write
more sheets, however, using the functions presented in the previous example will be more efficient. This is
because calling writeWorksheetToFile() multiple times will open, write and close the Excel file with each
call. Using the functions in the first example will, in contrast, allow you to open the workbook, do multiple
operations on it and only then close it.
In this example we will show how to write data into a named region. We will use the women dataset.
Similarly as in the example of writing an Excel sheet, we first load the workbook, using loadWorkbook(),
and then create a sheet named ”womenData”, using createSheet().
We then use createName() to produce a named region ”womenName”, starting in the C5 cell of the ”wom-
enData” sheet. Calling writeNamedRegion() writes the name into the workbook. At the end, we use
saveWorkbook() to write the Excel file to disk.
> require(XLConnect)
> wb <- loadWorkbook("XLConnectExample3.xlsx", create = TRUE)
> createSheet(wb, name = "womenData")
> createName(wb, name = "womenName", formula = "womenData!$C$5", overwrite = TRUE)
> writeNamedRegion(wb, women, name = "womenName")
> saveWorkbook(wb)
Figure 2: women dataset written into womenName named region in the XLConnectExample3.xlsx file
6
3.7 Example: writing a named region with one call
The writeNamedRegionToFile() function can be used to produce the same result as in the previous example,
with only one function call:
> require(XLConnect)
> writeNamedRegionToFile("XLConnectExample4.xlsx", women, name = "womenName",
+ formula = "womenData!$C$5")
readWorksheet() allows for reading data from a workbook that has been previously loaded and is passed
as the object argument. The name or index of the worksheet to read from should be passed as the sheet
argument. The startRow and startCol arguments specify the location of the top left corner of data to
be read, while endRow and endCol specify the bottom right corner. If header = TRUE, the first row is
interpreted as column names of the data.frame object read in.
If the startRow, startCol, endRow and endCol arguments are not specified, or are passed as <= 0, the
”bounding box” of the data is treated as the corresponding boundaries.
All arguments (except object) are vectorized, which allows for reading of multiple worksheets with one
call.
readWorksheetFromFile() allows for reading data from a workbook with one call, without loading the work-
book first. The file argument is the path of the file to read from. All arguments of the readWorksheet()
function can be passed within the ’...’ argument.
readNamedRegion() can be used for reading data from named region in an Excel workbook. The workbook
must first be loaded and passed as the object argument. Remaining arguments are the name of the named
region and header, specifying whether the first row of data should be interpreted as column names.
7
Read data from a named region of an Excel workbook
readNamedRegionFromFile() is a convenient wrapper function which allows for reading named regions from
an Excel file with one call. The function subsequently calls loadWorkbook() and readNamedRegion().
The file argument specifies the path to the Excel file to be read and name - the named region to be read.
The header argument specifies whether the first row of data should be interpreted as column names.
In this example, we will show how you can use XLConnect to read from an Excel sheet. For this purpose, we
will use the file created in the example in section 3.4. We set the endRow argument to 10, to limit the result.
We set the rest of arguments specifying boundaries as 0, so that they are automatically determined.
Please note, that alternatively to setting the sheet argument to the name of the sheet we want to read from,
"chickSheet", we could also specify it with the sheet index, as sheet = 1.
> require(XLConnect)
> wb <- loadWorkbook("XLConnectExample1.xlsx", create = TRUE)
> data <- readWorksheet(wb, sheet = "chickSheet", startRow = 0, endRow = 10,
+ startCol = 0, endCol = 0)
> data
weight Time Chick Diet
1 42 0 1 1
2 51 2 1 1
3 59 4 1 1
4 64 6 1 1
5 76 8 1 1
6 93 10 1 1
7 106 12 1 1
The readWorksheetFromFile() function can be used to, with only one call, obtain the same result as was
shown in the previous example:
> require(XLConnect)
> data <- readWorksheetFromFile("XLConnectExample1.xlsx", sheet = "chickSheet",
+ startRow = 0, endRow = 10, startCol = 0, endCol = 0)
8
3.11 Example: reading from an Excel named region
In this example, we will show how to use XLConnect’s functions to read from a named region in an Excel
file. We will use the file created in the example in section 3.6.
> require(XLConnect)
> wb <- loadWorkbook("XLConnectExample3.xlsx", create = TRUE)
> data <- readNamedRegion(wb, name = "womenName")
> data
height weight
1 58 115
2 59 117
3 60 120
4 61 123
5 62 126
6 63 129
7 64 132
8 65 135
9 66 139
10 67 142
11 68 146
12 69 150
13 70 154
14 71 159
15 72 164
3.12 Example: reading from an Excel named region with one call
The result obtained in the previous example can be reproduced by calling the wrapper function:
readNamedRegionFromFile(), witout the necessity of loading the workbook first:
> require(XLConnect)
> data <- readNamedRegionFromFile("XLConnectExample3.xlsx", "womenName")
In this example, we will show an example use case of XLConnect: generation of a simple Excel report,
showing the development of exchange rates (CHF vs EUR, USD and GBP).
For this example we will be using additional packages:
• zoo: S3 Infrastructure for Regular and Irregular Time Series
• ggplot2: An implementation of the Grammar of Graphics
9
install . packages ( c (" XLConnect " , " zoo " , " ggplot2 "))
10
> setDataFormat(csDate, format = "yyyy-mm-dd")
> # Create a highlighting cell style
> csHlight <- createCellStyle(wb, name = "highlight")
> setFillPattern(csHlight, fill = XLC$FILL.SOLID_FOREGROUND)
> setFillForegroundColor(csHlight, color = XLC$COLOR.CORNFLOWER_BLUE)
> # Apply header cell style to the header row
> setCellStyle(wb, sheet = sheet, row = 1,
+ col = seq(length.out = ncol(curr)),
+ cellstyle = csHeader)
> # Index for all rows except header row
> allRows <- seq(length = nrow(curr)) + 1
> # Apply date cell style to the Date column
> setCellStyle(wb, sheet = sheet, row = allRows, col = 1,
+ cellstyle = csDate)
> # Set column width such that the full date column is visible
> setColumnWidth(wb, sheet = sheet, column = 1, width = 2800)
> # Check if there was a change of more than 2% compared
> # to the previous day (per currency)
> idx <- rollapply(curr[, -1], width = 2,
+ FUN = function(x) abs(x[2] / x[1] - 1),
+ by.column = TRUE) > 0.02
> idx <- rbind(rep(FALSE, ncol(idx)), idx)
> widx <- lapply(as.data.frame(idx), which)
> # Apply highlighting cell style
> for (i in seq(along = widx)) {
+ if (length(widx[[i]]) > 0) {
+ setCellStyle(wb, sheet = sheet, row = widx[[i]] + 1, col = i + 1,
+ cellstyle = csHlight)
+ }
+
+ # Note:
+ # +1 for row since there is a header row
+ # +1 for column since the first column is the time column
+ }
> saveWorkbook(wb)
As a next step, let’s add a graph to our report.
> wb <- loadWorkbook(wbFilename)
> # Stack currencies into a currency variable (for use with ggplot2 below)
> currencies <- names(curr)[-1]
> gcurr <- reshape(curr, varying = currencies, direction = "long", v.names = "Value",
+ times = currencies, timevar = "Currency")
> # Create a png graph showing the currencies in the context
> # of the Swiss Franc
> png(filename = "swiss_franc.png", width = 800, height = 600)
> p <- ggplot(gcurr, aes(Date, Value, colour = Currency)) +
+ geom_line() + stat_smooth(method = "loess") +
+ scale_y_continuous("Exchange Rate CHF/CUR") +
+ labs(title = paste0("CHF vs ", paste(currencies, collapse = ", ")),
+ x = "") +
+ theme(axis.title.y = element_text(size = 10, angle = 90, vjust = 0.3))
> print(p)
> dev.off()
> # Define where the image should be placed via a named region;
11
> # let's put the image two columns left to the data starting
> # in the 5th row
> createName(wb, name = "graph",
+ formula <- paste(sheet, idx2cref(c(5, ncol(curr) + 2)), sep = "!"))
> # Note: idx2cref converts indices (row, col) to Excel cell references
>
> # Put the image created above at the corresponding location
> addImage(wb, filename = "swiss_franc.png", name = "graph",
+ originalSize = TRUE)
> saveWorkbook(wb)
As a result, we obtain the following graph:
1.1
Exchange Rate CHF/CUR
1.0
Currency
EUR
0.9 GBP
USD
0.8
0.7
Jan 2014 Apr 2014 Jul 2014 Okt 2014 Jan 2015
Check out the Excel file to see how the data and the graph have been exported!
12
5 What’s new in XLConnect version 0.2-15
We have introduced the following updates in version 0.2-15 of XLConnect:
• Upgraded XLConnectJars dependency to version 0.2-15
• Rely on Java version check from XLConnectJars which now supports Java 10
A summary of news in XLConnect 0.2-15 can be found in the NEWS file on CRAN.
Question:
I’m running out of memory when processing large data sets:
writeNamedRegionToFile ( file = " huge . xls " , data = giant . data . frame ,
namedRegion = " LargeRegion " , formula = " LotsOfData ! A1 " )
Answer:
This is caused by the fact that XLConnect needs to copy your entire data object over to the JVM in order
to write it to a file and the JVM has to be initialized with a fixed upper limit on its memory size. To change
this amount, you can pass parameters to R’s JVM just like you can to a command line Java process via
rJava’s options support:
Note, however, that these parameters are evaluated exactly once per R session when the JVM is initialized
- this is usually once you load the first package that uses Java support, so you should do this as early as
possible.
13
Some general Java advice: The upper limit of the Xmx parameter is system dependent - most prominently,
32bit Windows will fail to work with anything much larger than 1500m, and it is usually a bad idea to set
Xmx larger than your physical memory size because garbage collection and virtual memory do not play well
together.
Question:
How can I style my output - set fonts, colors etc?
Answer:
XLConnect does not currently allow direct access to low-level formatting options. However, it is pos-
sible to assign named cell styles to cells, so the preferred workflow would be to:
1. define some named cell styles in an Excel document (”Format” -> ”Styles” in pre-2007 Excel, ”Cell
styles” on the default pane of Excel 2007 and on)
2. save the document to a file
3. then load this template in XLConnect and use the setCellStyle method to assign the predefined styles:
library ( XLConnect )
w <- loadWorkbook ( " template . xls " )
df <- data . frame ( " foo " )
c <- getCellStyle (w , " FatFont " )
Question:
I’m getting errors trying to import Excel data like:
or
14
Error : NotImplementedException ( Java ): Error evaluating cell Sheet1 ! A1
Answer:
This type of error is triggered when XLConnect can not determine the value of a cell in the region
you’re trying to import. Usually, this happens because Apache POI does not support all possible Excel
formulae.
There is no direct solution for accessing the values of fields that Apache POI doesn’t know how to compute.
However, if you can live without the cell values and just want to ignore uncomputable cells, have a look at
the onErrorCell function to tell XLConnect that you want to ignore errors.
If you have Excel and are willing to invest some manual effort, you can manually create a static copy, that
can be imported as follows:
• Select the region containing your data
• Edit -> Copy
• Select an empty cell and Edit -> Paste Special
• In the Paste radio group, select Values
You should then be able to import the pasted region without problems.
Please log any bug reports, feature requests or technical inquiries at:
https://github.com/miraisolutions/xlconnect/issues
For any other feedback you may have, please contact us at:
[email protected]
15
4. XLConnect on RDocumentation:
https://www.rdocumentation.org/packages/XLConnect
5. XLConnect on METACRAN:
https://www.r-pkg.org/pkg/XLConnect
6. XLConnect on crantastic!:
https://crantastic.org/packages/XLConnect
7. XLConnect in the R Programming section on Wikibooks:
https://en.wikibooks.org/wiki/R Programming/Importing and exporting data
8. Quick Intro to XLConnect:
http://altons.github.io/rstats/2015/02/13/quick-intro-to-xlconnect/
9. ”How to Read Data from Excel into R”, article by Joris Meys and Andrie de Vries:
http://www.dummies.com/how-to/content/how-to-read-data-from-excel-into-r.html
10. R and Excel: Making Your Data Dumps Pretty with XLConnect:
https://www.youtube.com/watch?v=G3mOUbZr4HI
http://amunategui.github.io/excel-data-dumps/
16