Merge1 User Guide
Merge1 User Guide
User Guide
Version 7.0.2305
Merge1
Merge1 | User Guide
LEGAL NOTICE
The software described in this guide is furnished under a license agreement and may be used only in accordance
with the terms of the agreement.
Veritas and the Veritas Logo are trademarks or registered trademarks of Veritas Technologies LLC or
its affiliates in the U.S. and other countries. Other names may be trademarks of their respective
owners.
This product may contain third-party software for which Veritas is required to provide attribution to
the third party (“Third-party Programs”). Some of the Third-party Programs are available under open
source or free software licenses. The License Agreement accompanying the Software does not alter
any rights or obligations you may have under those open source or free software licenses. Refer to
the Third-party Legal Notices document accompanying this Veritas product or available at:
https://www.veritas.com/about/legal/license-agreements.
The product described in this document is distributed under licenses restricting its use, copying,
distribution, and decompilation/reverse engineering. No part of this document may be reproduced in
any form by any means without the prior written authorization of Veritas Technologies LLC and its
licensors, if any.
THE DOCUMENTATION IS PROVIDED "AS IS" AND ALL EXPRESS OR IMPLIED CONDITIONS,
REPRESENTATIONS, AND WARRANTIES, INCLUDING ANY IMPLIED WARRANTY OF MERCHANTABILITY,
FITNESS FOR A PARTICULAR PURPOSE OR NON-INFRINGEMENT, ARE DISCLAIMED, EXCEPT TO THE
EXTENT THAT SUCH DISCLAIMERS ARE HELD TO BE LEGALLY INVALID. VERITAS TECHNOLOGIES LLC
SHALL NOT BE LIABLE FOR INCIDENTAL OR CONSEQUENTIAL DAMAGES IN CONNECTION WITH THE
FURNISHING, PERFORMANCE, OR USE OF THIS DOCUMENTATION. THE INFORMATION CONTAINED IN
THIS DOCUMENTATION IS SUBJECT TO CHANGE WITHOUT NOTICE.
The Licensed Software and Documentation are deemed to be commercial computer software as
defined in FAR 12.212 and subject to restricted rights as defined in FAR Section 52.227-19
"Commercial Computer Software - Restricted Rights" and DFARS 227.7202, et seq. "Commercial
Computer Software and Commercial Computer Software Documentation," as applicable, and any
successor regulations, whether delivered by Veritas as on-premises or hosted services. Any use,
modification, reproduction release, performance, display, or disclosure of the Licensed Software and
Documentation by the U.S. Government shall be solely in accordance with the terms of this
Agreement.
2
Merge1 | User Guide
CONTENTS
WELCOME TO MERGE1 .................................................................................................................................... 5
INTRODUCTION .................................................................................................................................................. 6
SYSTEM REQUIREMENTS .................................................................................................................................. 14
DASHBOARD .................................................................................................................................................. 58
DASHBOARD SECTION ...................................................................................................................................... 59
IMPORTER JOBS ................................................................................................................................................ 61
IMPORTERS.................................................................................................................................................... 63
AMAZON S3 ...................................................................................................................................................... 80
BLACKBERRY ..................................................................................................................................................... 81
BLOOMBERG .................................................................................................................................................... 83
BOX ................................................................................................................................................................... 91
CHATTER ........................................................................................................................................................... 96
CHATTER CIPHER CLOUD ................................................................................................................................ 104
CISCO WEBEX TEAMS ..................................................................................................................................... 106
CITRIX WORKSPACE & SHAREFILE ................................................................................................................... 113
CROWD COMPASS .......................................................................................................................................... 119
DB ................................................................................................................................................................... 121
DROPBOX BUSINESS ....................................................................................................................................... 124
EML................................................................................................................................................................. 129
EWS ................................................................................................................................................................ 131
EXCHANGE GRAPH API ................................................................................................................................... 148
FX CONNECT ................................................................................................................................................... 154
GOOGLE DRIVE ............................................................................................................................................... 157
ICECHAT .......................................................................................................................................................... 167
JABBER ENTERPRISE ....................................................................................................................................... 168
JSON ............................................................................................................................................................... 176
MICROSOFT TEAMS ........................................................................................................................................ 178
MICROSOFT TEAMS MEETINGS ...................................................................................................................... 192
MICROSOFT TEAMS VIA EXPORT API .............................................................................................................. 200
MICROSOFT TEAMS VIA WEBHOOKS .............................................................................................................. 213
ONEDRIVE FOR BUSINESS ............................................................................................................................... 227
PIVOT .............................................................................................................................................................. 235
3
Merge1 | User Guide
4
WELCOME TO MERGE1
CHAPTER 1
Welcome to Merge1
INTRODUCTION
General Overview
Merge1 aids financial service firms in complying with SEC rule 17-a4, CFTC rule 1.31, Dodd-Frank
requirements, FINRA, and other regulatory agencies. It also greatly reduces legal risks by streamlining
the discovery of e-communications data, aiding organizations across all verticals with internal
investigations, lawsuits, and audits. Merge1 offers excellent compatibility with Microsoft Exchange,
Microsoft Office 365, and many other applications.
Merge1 is an internal cloud computing environment that is deployed and administered within a
private network. Internal cloud environments can be utilized anywhere within the same network by
several people on multiple machines simultaneously while demanding very few system resources.
Note
Merge1 collectors are designed to be deployed for scheduled ongoing capture runs. Even though
collectors can be run against older data for targeted discovery purposes, using Merge1 collectors to
migrate large amounts of data is not supported. The capture platform is not built as a migration tool
designed to run long term migration tasks with accompanying monitoring/reconciliation/reporting
features that are required for such a tool. Running tasks for long periods of time runs the risk of
failure to complete successfully.
6
Merge1 | User Guide
WELCOME TO MERGE1
May 1, 2023
The changes are represented in the table below:
Chapter/Section Changes
System Requirements/Software Requirements Added a note for software compatibility lists.
Getting Started/ Merge1 Upgrade Added a new section.
Configuring the SSO Authentication/JIT Added a new functionality.
Provisioning
Microsoft Teams via Export API/Activities Updated the list of captured activities.
Captured
Microsoft Teams via Export API/Requesting Updated the section.
Access to Protected APIs
Microsoft Teams via Export API/Enabling Added a new section.
Billing for Microsoft Teams APIs in Microsoft
Graph
Microsoft Teams via Webhooks/Requesting Updated the section.
Access to Protected APIs
Microsoft Teams via Webhooks/ Enabling Added a new section.
Billing for Microsoft Teams APIs in Microsoft
Graph
Yammer/Activities Captured Added new notes.
Monitored Users Updated the UI of the Monitored Users tab.
Monitored Users Updated the section.
Targets/Microsoft Office 365 EWS Target Updated the section.
7
Merge1 | User Guide
WELCOME TO MERGE1
April 3, 2023
The changes are represented in the table below:
Chapter/Section Changes
Cisco Webex Teams/Miscellaneous Settings Updated the section.
Microsoft Teams/Advanced Configuration Updated the section.
Options
Microsoft Teams via Export API/Advanced Updated the section.
Configuration Options
Microsoft Teams via Webhooks/Advanced Updated the section.
Configuration Options
Microsoft Teams via Export API/Activities Updated the list of captured activities.
Captured
Microsoft Teams via Export API/Threading and Updated the section.
Formatting
RingCentral/Advanced Configuration Options Updated the section.
ServiceNow/Advanced Configuration Options Updated the section.
Yammer/Advanced Configuration Options Updated the section.
YouTube/Advanced Configuration Options Updated the section.
Licensing/License Details Updated the User Interface.
Targets/Azure Blob Target Added a new target.
March 6, 2023
The changes are represented in the table below:
Chapter/Section Changes
Introduction/General Overview Added a note.
JSON Added a new collector.
Yammer/Activities Captured Updated the list of captured activities.
Yammer/Advanced Configuration Options Added new fields.
Zoom Chat Added a new collector.
Zoom Meetings/Activities Captured Removed a footnote.
February 6, 2023
The changes are represented in the table below:
Chapter/Section Changes
Microsoft Teams via Export API/Activities Updated the list of captured activities.
Captured
8
Merge1 | User Guide
WELCOME TO MERGE1
Microsoft Teams via Export API/Threading and Added a note about the message formatting.
Formatting
Zoom Meetings Chats Added a new collector.
Reports/Audit Added new event types.
January 2, 2023
The changes are represented in the table below:
Chapter/Section Changes
Getting Started/Preinstallation Checklist Updated the list of prerequisites.
Signing In/Configuring SSO Authentication in Added the Signed Authentication Request to the
Merge1 SSO Authentication.
Microsoft Teams via Export API/Activities Updated the list of captured activities.
Captured
Microsoft Teams via Webhooks/Activities Updated the list of captured activities.
Captured
OneDrive for Business/Activities Captured Updated the list of captured activities.
December 5, 2022
The changes are represented in the table below:
Chapter/Section Changes
9
Merge1 | User Guide
WELCOME TO MERGE1
November 7, 2022
The changes are represented in the table below:
Chapter/Section Changes
October 3, 2022
The changes are represented in the table below:
Chapter/Section Changes
September 5, 2022
The changes are represented in the table below:
Chapter/Section Changes
10
Merge1 | User Guide
WELCOME TO MERGE1
August 1, 2022
The change is represented in the table below:
Chapter/Section Changes
Microsoft Teams via Export API/Configuring Captured Modern Attachment has been added to
the Collector in Merge1 the Attachments Configuration section.
Microsoft Teams via Export API/Configuring Updated the list of captured activities.
the Collector in Merge1
MobileGuard Removed the collector.
July 4, 2022
The changes are represented in the table below:
Chapter/Section Changes
OneDrive for Business/Configuring the Include original data as the attachment has been
Collector in Merge1 moved to the Attachments Configuration section.
11
Merge1 | User Guide
WELCOME TO MERGE1
Microsoft Teams via Export Include original data as the attachment has moved to
API/Configuring the Collector in Attachments Configuration section.
Merge1
Microsoft Teams via Export Added Splitting messages section.
API/Configuring the Collector in
Merge1
12
Merge1 | User Guide
WELCOME TO MERGE1
Sources
Merge1 collects data from an array of e-communication media.
New sources are frequently being added, feel free to contact Veritas Technologies LLC Support for
new additions or requests.
Please note that files and attachments, greater than 2 GB are not being processed.
13
Merge1 | User Guide
WELCOME TO MERGE1
SYSTEM REQUIREMENTS
Having more processor cores will ensure adequate performance in instances where multiple
importers are consistently being run simultaneously.
Software Requirements
For Merge1 Web Servers:
• Internet Information Services 8.0 or higher
• SQL Server 2014 or later
• .NET Framework 4.8
Please ensure to consult the latest version of the Merge1 Compatibility Chart for information on all
supported components including OS and SQL available at
https://www.veritas.com/support/en_US/doc/Merge1_7.0_CompatibilityCharts.
Important Notes
• Merge1 Web Services and Agent VM must be on the same time zone.
• Any path that is used for Merge1 should be visible to the Agent
14
GETTING STARTED
CHAPTER 2
Getting Started
This chapter represents:
• Preinstallation Checklist
• Installation
• Database Configuration
• Signing In
• Activating a License
Merge1 | User Guide
GETTING STARTED
PREINSTALLATION CHECKLIST
Merge1 utilizes port 443 on the host machine for network distribution as well as OAuth pull calls to
ensure that it is not occupied by another application. The default ports used for SSH Authentication
by Bloomberg and IceChat are 30206 and 22, respectively. The default FTP port for any Source is 21.
Microsoft Internet Explorer versions 8 and below will not properly display some elements of the user
interface and should not be used. Merge1 will never prompt you to update your browser.
Ensure that all the hardware and software requirements are met:
• 2.4 GHz or faster quad-core processor with at least 16 GB RAM and 1 GB hard-disk space
• Windows Server 2016 or later, x64-based
• Internet Information Services 8.0 or higher (see Installing Internet Information Services)
• SQL Server 2014 or later
• .NET Framework 4.8 (see Verifying .Net Framework Requirements)
• NET 6.0 Runtime
• ASP.NET Core 6.0 Runtime
Please ensure to consult the latest version of the Merge1 Compatibility List for information on all
supported components including OS and SQL available at
https://www.veritas.com/support/en_US/doc/Merge1_7.0_CompatibilityCharts.
• EV Targets:
- Veritas Enterprise Vault 12.1 up to 14.3
- Enterprise Vault API Runtime 12 or 14 (on the Merge1 host)
• EWS Targets:
- Microsoft Exchange Server 2007 SP1, 2010 (GA – SP3), 2013, 2016, and 2019
• SMTP Targets:
- Microsoft Exchange Server 2003, 2007, 2010, 2013, 2016, and 2019
Notes
• You can acquire the username and password of the administrator account on the host
machine.
• Make a note of the address and authentication parameters of the SQL server that will host
Merge1's databases.
• Acquire an SSL certificate (see Creating a Self-Signed Certificate in the PREINSTALLATION
STEPS).
• All processes, services, and folder paths (the installation path and paths specified in the
collector settings) related to Merge1 should be added to the exclusion list of the antivirus
software, if there is one installed on the machine.
16
Merge1 | User Guide
GETTING STARTED
PREINSTALLATION STEPS
Installing Internet Information Services
To install Internet Information Services on Windows Server 2012 and later versions:
1. Click Start > Administrative Tools > Server Manager.
2. On the left panel of the Server Manager dialog box, click Roles.
- If IIS has not been enabled, click Add Roles on the Roles Summary panel. Click Next
and enable Web Server (IIS) on the list. Then, click Next and select Role Services in
the left panel.
- If IIS is already enabled, but not all required components have been enabled, click
Add Role Services in the Web Server (IIS) panel on the right.
3. On the Select Role Services dialog box, verify that the web server components listed below
are enabled.
4. After enabling the required IIS components, click Next > Install.
Web Server
▪ Common HTTP features
- Default document
- Static content
▪ Security
- Basic authentication
- Request Filtering
- Windows authentication
▪ Application Development
- All .NET extensibility components
- All ASP.NET components
- ISAPI extensions
- ISAPI filters
17
Merge1 | User Guide
GETTING STARTED
Application pools can be viewed in IIS Manager. If the .NET v4.8 and .NET v4.8 Classic application
pools do not appear on the list, please reinstall, or repair .NET Framework 4.8 after installing Internet
Information Services.
18
Merge1 | User Guide
GETTING STARTED
3. Specify a name and click OK and on the next window, select your certificate from the list and
click Export in the Actions column to the right.
The certificate location and password must be provided when installing Merge1.
19
Merge1 | User Guide
GETTING STARTED
INSTALLATION
Starting from version 7.0, Merge1 comes up with two installers – Merge1 7.0 Setup and Merge1
Agent MSIs. Note that both should have the same version.
Merge1 Setup
To install Merge1:
1. Run the Merge1 7.0 Setup installer with administrator permissions and click Next.
20
Merge1 | User Guide
GETTING STARTED
The Sender Email will appear in the From field when a confirmation email is sent to new users or
when passwords are reset.
21
Merge1 | User Guide
GETTING STARTED
6. Enter the Username and Password of the administrator account of the host machine and
specify the SSL certificate path and password. Make a note of the Host URL - this URL is
needed to access the Merge1 platform, then click Next.
22
Merge1 | User Guide
GETTING STARTED
The Provider Name may be changed to assign a unique name to an environment (useful when
multiple environments are deployed within the same network, i.e., Merge1 HR, Merge1 PR, etc.
8. Click Install to begin the installation. The installation window will open.
23
Merge1 | User Guide
GETTING STARTED
You will have a 30-day free trial license period after the installation. Then, contact us to prolong the
license.
After Merge1 installation, it is recommended to reset the IIS via PowerShell as an administrator.
Merge1 Agent
To install Merge1 Agent:
1. Run the Merge1 Agent installer and click Next.
2. Read and accept the End-User License Agreement by scrolling down and clicking Next.
24
Merge1 | User Guide
GETTING STARTED
4. Click Install.
When the installation is completed, the Merge1 Agent folder will be in C:\Program
Files\Veritas Technologies LLC. For more information on how to manage Agent Pools, see
AGENT POOLS.
25
Merge1 | User Guide
GETTING STARTED
Merge1 Upgrade
Uninstall all previous versions of Merge1 before version 6.21.2203 prior to attempting to install
version 7.0 and later versions.
26
Merge1 | User Guide
GETTING STARTED
In case the database is not updated, the user will have to create a new database for Merge1 version
7.0.
27
Merge1 | User Guide
GETTING STARTED
AGENT POOLS
This section describes agent pools and agents which can execute a particular Import Job.
The Agent Pool is a virtual/logical container for one or multiple Agents.
The Agent is the component that executes Jobs. When a job execution request is queued, the Agent
manager selects an agent from the pool and sends the job request to the agent. For an agent to get
elected by the manager, it must meet certain conditions:
Note
Each agent must be registered in Merge1 Web and Agent Pool by the user. All jobs are assigned to the
default agent pool.
In the Agent Pools section of the Navigation Pane, the following information is available:
• Name. The name of the Agent Pool.
• Agent Count. The count of the agents in the specific pool.
Note that an Agent Pool cannot be added. Only Default Agent Pool is available for managing agents.
Registering an Agent
1. Open the Merge1 Agent folder from C:\Program Files\Veritas Technologies LLC
folder in Windows PowerShell as an administrator.
1
The capacity is set by the user during agent registration.
28
Merge1 | User Guide
GETTING STARTED
1. In PowerShell, type the following command to unblock the possible blocked files:
dir -Path ./ -Recurse | Unblock-File
2. Use the following command to register an Agent:
./agentConfigurator.exe register -u "<Portal>" -i "<ApplicationID>" s"<ClientSecret>" -a
"<AgentName>"
3. Make sure to set the following variables in the command:
a. -u "<Portal>". The Merge1 instance URL. You can find it in
</Merge1_installation_directory/Globanet Consulting
Services\Merge1 7.0 >. 1
b. -i "<ApplicationID>". The application ID of the created application in API
Clients (see Adding a New Application).
c. -s "<ClientSecret>". The secret of the above-used application copied and saved
priorly (see Adding a Secret).
d. -a "<AgentName>". The agent name.
1 In case of Merge1 version 6.0, the path will be \Merge1 Installation Directory\Globanet Consulting Services\Merge1 6.0\.
29
Merge1 | User Guide
GETTING STARTED
Starting an Agent
The Agent can be started in two ways:
1. If the --noservice command was used during an Agent registration, type the following
command to start the Agent (see the above section for Agent registration):
30
Merge1 | User Guide
GETTING STARTED
To open the Services app, click Windows Start, and type Services.
Configuring an Agent
1. Click Default Agent Pool and the Agent Pool details page will open.
Note that when an Agent is online, but it is disabled, it will not run a job.
2. Click the Expand button left to the Agent name to see the following additional information
(Figure 29):
• InstalledMemoryDB. Shows the actual memory available for an Agent job.
31
Merge1 | User Guide
GETTING STARTED
• ProcessorCount. Shows the available resources on an Agent server. This is the number of
logical processors of the CPU installed on the Agent server.
Deleting/Unregistering an Agent
An Agent can be deleted/unregistered in two ways:
1. Deleting an Agent from the Agents grid.
a. Go to Agent Pools > Default Agent Pool.
b. Click the Delete button under Actions and the Agent will be deleted.
2. Unregister an Agent using a command line.
a. Stop the Agent from the Windows Services App, or in Windows PowerShell (Ctrl + c) if
it is registered with the --noservice flag.
b. Use the following command to unregister the Agent:
./agentConfigurator.exe unregister
32
Merge1 | User Guide
GETTING STARTED
DATABASE CONFIGURATION
To access the Merge1 portal, use the shortcut in the Start Menu or use the Merge1 Host URL from
the installation wizard using a web browser of your choice. Merge1's configuration settings will
appear.
Note
Never attempt to access or administer Merge1 using localhost in place of the URL as callback
functions will not work properly, and critical errors may occur.
33
NAVIGATING TO MERGE1
CHAPTER 3
Navigating to Merge1
SIGNING IN
The starting screen of the Merge1 is the Login Screen. It serves as a gateway to viewing and modifying
the data in the application.
To sign in to Merge1:
1. Navigate to the Start Menu shortcut to access the Merge1 portal.
By default, only the Merge1 Authentication and Windows Authentication options are available as
Authentication Types to select at the time of login. The Single Sign On (SSO) option will become visible
in the drop-down list after CONFIGURING THE SSO AUTHENTICATION.
For Windows Authentication, add an account from the domain where Merge1 is hosted. Use the SAM
account name in the Username field.
• Username: exampledomain.com\admin
• Password: <user’s password>.
To log in with Windows Authentication, you should have already selected an AD user. For more
information, see Select an AD User Account (Recommended per industry best practice).
The AD user must have login access to the Merge1 Server, to login into the Merge1 Portal using the
Windows Authentication mode.
35
Merge1 | User Guide
NAVIGATING TO MERGE1
For Single Sign-On with SAML 2.0, see CONFIGURING THE SSO AUTHENTICATION.
Password Recovery
The system is designed to provide the functionality of retrieving user passwords in case of forgetting
or for some other reason. Passwords are retrieved through the identification link sent to the user’s
email address contained in the user profile. When a user clicks the link in the email, the user identity
will be verified, and an opportunity for defining new password will be provided.
36
Merge1 | User Guide
NAVIGATING TO MERGE1
Password requirements:
• Minimum length of 12 characters.
• Combination of upper and lowercase letters, numbers, and symbols.
Upon logging in for the first time, navigate to the Licensing section for licensing (see LICENSING).
37
Merge1 | User Guide
NAVIGATING TO MERGE1
Below are described all the steps for configuring Okta (IDP) and Microsoft Azure Application, but you
can use any Identity provider's service that supports SAML 2.0.
38
Merge1 | User Guide
NAVIGATING TO MERGE1
39
Merge1 | User Guide
NAVIGATING TO MERGE1
8. Click Edit to add the Identifier (Entity ID) and Reply URL (Assertion Consumer Service
URL) from the Merge1 portal Authentication section.
40
Merge1 | User Guide
NAVIGATING TO MERGE1
9. Go to Merge1 Authentication and enable the Single Sign-On (SSO) With SAML 2.0
checkbox. The SAML 2.0 Configuration section opens.
10. Under the Metadata URL option in the Merge1 Authentication section:
a. Copy the value of Entity ID and provide it as an Identifier (Entity ID) in the Microsoft
Azure application.
b. Copy the value of SSO URL and provide it as a Reply URL (Assertion Consumer Service
URL) in the Microsoft Azure application.
11. Click Save.
2. Click None Selected under Users and groups, select the user, and click Assign.
41
Merge1 | User Guide
NAVIGATING TO MERGE1
The assigned user details will appear on the Users and groups page.
42
Merge1 | User Guide
NAVIGATING TO MERGE1
43
Merge1 | User Guide
NAVIGATING TO MERGE1
44
Merge1 | User Guide
NAVIGATING TO MERGE1
6. Copy the value of the SSO URL and paste it as a Single sign-on URL in the Okta application.
7. Copy the value of Entity ID and paste it as Audience URI (SP Entity ID) in the Okta application.
8. In the Okta application, scroll down to Attribute Statement (optional).
45
Merge1 | User Guide
NAVIGATING TO MERGE1
11. Click Next, select I'm a Software vendor, and then click Finish.
2. Provide First name, Last name, and Username, and click Save.
3. Click Activate Person and go by the link sent to the email for confirmation.
46
Merge1 | User Guide
NAVIGATING TO MERGE1
4. Go to Applications > Applications and select the application that was created.
47
Merge1 | User Guide
NAVIGATING TO MERGE1
5. The metadata URL will be opened in a new tab. Copy and save it for later use in case of
configuring SSO via Metadata URL.
48
Merge1 | User Guide
NAVIGATING TO MERGE1
3. Copy the IDP metadata and save it for later use in case of configuring SSO via Metadata
Content.
49
Merge1 | User Guide
NAVIGATING TO MERGE1
50
Merge1 | User Guide
NAVIGATING TO MERGE1
3. Select the User or Group, a respective role to the user/group, and click Assign.
1. Sign in with SSO on the login page, authenticate with the user which is assigned to the Azure
app and the user will be automatically created in the Users and Groups section with a role
that you have provided in Azure.
Note
The role cannot be changed from Merge1. If you want to change the role for the JIT user, you
need to change it in Azure. Next time, when the user is signed in to Merge1, the role would
be already changed.
2. Check it by navigating to the Merge1 Users & Groups section and clicking the edit button next
to the user.
51
Merge1 | User Guide
NAVIGATING TO MERGE1
When enabling Single Sign-On (SSO) with SAML 2.0, the SAML 2.0 Configuration opens. The user can
select configuring SSO either via Metadata URL or Metadata Content.
52
Merge1 | User Guide
NAVIGATING TO MERGE1
4. Click Save. The Single Sign-On (SSO) option will become visible in the Authentication method
drop-down list.
6. In case you activate Upload file (*.pfx), click the Select button to upload the certificate and
then provide X.509 Certificate Password.
7. Check Enable Just-In-Time User Provisioning (Azure AD Only). For more information see Just-
In-Time Provisioning (JIT).
53
Merge1 | User Guide
NAVIGATING TO MERGE1
8. Click Save. The Single Sign-On (SSO) option will become visible in the Authentication method
drop-down list.
54
Merge1 | User Guide
NAVIGATING TO MERGE1
NAVIGATION PANE
The UI of Merge1 consists of two parts: Main screen and Navigation Pane. You can easily switch
between the different sub-sections of the software through the Pane. Merge1 Navigation Pane
consists of the following shortcuts:
DASHBOARD
Here you can view all the statistical and logistical information about your Merge1 activities.
IMPORTERS
Here you can connect or remove company-relevant Importers, configure targets, and set
filters.
Here you can view the basic information of all the users and groups who can log in to the
company’s Merge1 account.
REPORTS
Here you can export Audit reports of each collector in a PDF or CSV format.
SETTINGS
Here you can view and/or customize the database, audit, proxy, and authentication
configurations, as well as manage Message settings.
BRANDING SETTINGS
Here you can make Merge1 on your own!
LICENSING
Here you can activate a license and view the version of your Merge1.
API CLIENTS
Here client applications can have access to the Merge1 API.
AGENT POOLS
AUTHENTICATION
Here Merge1 authentication types can be configured.
JOB MONITORING
Here Merge1 import jobs can be monitored.
55
Merge1 | User Guide
NAVIGATING TO MERGE1
ACCOUNT SETTINGS
On the top right corner of the Main Screen, you can find your Account Settings which allows
modifying your account default settings.
To view your user Account Settings, click next to your username. A pop-up window will open. Click
ACCOUNT INFORMATION.
On the Account Information page, you can modify your default User Information, as well as change
your password configurations. The following settings refer solely to your personal account and have
no connection with general Merge1 Settings.
The Account Information section consists of two parts: User Information and Change Password.
User Information
To edit the user information:
1. Update your account First Name and Last Name fields when needed.
2. Update phone/mobile number when necessary.
3. Click the SAVE button in the User Information section.
56
Merge1 | User Guide
NAVIGATING TO MERGE1
Logging Out
To log out from your Merge1 Account, click next to your username and then click the SIGN OUT
button.
Once you have made all the relevant changes, click SAVE.
Please note that your account information will be visible to everyone on your company’s Merge1
account.
57
DASHBOARD
CHAPTER 4
Dashboard
This chapter represents:
• Managing Dashboard Section
• Managing Importer Jobs
Merge1 | User Guide
DASHBOARD
DASHBOARD SECTION
The Merge1 Dashboard provides interactive visual modules that represent statistical and logical
information about your Merge1 activity.
You can view the details of each job, user, or messages by hovering the mouse over the job you want,
and you will see the details of it.
You can download the information included in the Messages Proceeded by Merge1 and Number of
Messages by Importer in PDF, JPG, PNG or SVG formats by clicking the button. A pop-up list of
available formats will open.
59
Merge1 | User Guide
DASHBOARD
Select the format and the dashboard of the messages by Merge1 or the number of messages by
importers will be downloaded to your local PC.
60
Merge1 | User Guide
DASHBOARD
IMPORTER JOBS
The paragraphs that follow will describe how you can browse and set the number of entries per page
in the importer jobs.
Exporting to CSV
This section allows the user to export the dashboard for:
• The specified importer by selecting the collector from the Collectors list drop-down list
• The specified date range by selecting FROM and TO dates from the calendar
61
Merge1 | User Guide
DASHBOARD
62
IMPORTERS
CHAPTER 5
Importers
This chapter represents:
• Importers
• File-Based Collector Options
• Configuration Wizard
• Monitored Users
• Filters
• Targets
• Importer Settings
Merge1 | User Guide
IMPORTERS
Overview
The Importers section allows you to add, connect or remove company relevant importers, configure
targets, and set filters.
Importer Panels
Merge1 importer panel is comprised of the following components:
• COLLECTORS (SOURCES). Contains general information about the collector and how to
manage it.
• MONITORED USERS. Contains information about all the users of the collector and its
configurations.
• TARGETS. Allows setting up where the collector information should be is sent.
• IMPORTER SETTINGS. Helps to configure settings to load filtered data to the destination
target.
64
Merge1 | User Guide
IMPORTERS
2. Fill in the Name and the Description fields and click NEXT. The next wizard will open where
you can find all the sources provided by Merge1.
65
Merge1 | User Guide
IMPORTERS
66
Merge1 | User Guide
IMPORTERS
Note
From collector to collector the Source tab may vary.
Managing an Importer
The options for managing the importers are:
• Clone. Allows copying the importer with all the previously configured settings.
• Edit. Allows editing the settings of the collector.
• Rename. Allows changing the name and the description of the importer.
• Delete. Deletes the importer with all the configured settings.
Note
If the importer is deleted, it will not be possible to recover it.
Running an Importer
An importer can be run using 2 ways: using the scheduler or using the start import button.
67
Merge1 | User Guide
IMPORTERS
2. When the time is achieved and a free agent is available, the running status will become
Queued.
3. After 30 seconds the status will be changed to Running: the job will run.
2. When a free agent is available, after 30 seconds the status will be changed to Running: the
job will run.
.
Figure 90: Scheduler: Off, Status: Running
68
Merge1 | User Guide
IMPORTERS
If the scheduler is enabled for an importer and the start import button is set to Queued for the same
importer, even if the running time is not achieved set by Importer Schedule, the job will run (in case a
free agent is available).
Notes
• When the start import button is set to on for a job, and a scheduler is enabled for another
one, a free agent will run the job which was scheduled earlier.
• Even if the Importer Schedule is set, but the scheduler is not enabled, the job will not be
queued.
The second way is to select Delete under Importer Settings. It also removes all collector data history
from the previous runs.
If the Delete <Collector Name>'s associated components’ data option is checked, all the failed
messages and failed sessions are also deleted from the database.
69
Merge1 | User Guide
IMPORTERS
File Source
For file collectors there are the following options to configure the source:
• None
• FTP
• Amazon S3
• Azure Storage1
If None is selected, the files from the Import folder are processed.
For Connection:
1. Enter the hostname of the remote FTP server and the folder path in the Host and Path text
boxes, respectively. The default port is 21.
2. Choose FTP connection type from the Connection Type drop-down list. FTP can run in either
passive or active mode. The information about the connection type should be provided by the
FTP host. If you wish to use FTP over SSL, mark the Use Security checkbox and choose the
connection method Implicit SSL, Explicit SSL or SSH.
For Authentication:
1. Enter the Username and Password fields, respectively.
2. To enable anonymous FTP connections, enable the Anonymous Access checkbox which is the
default settings.
70
Merge1 | User Guide
IMPORTERS
To capture data from Amazon S3, triggers and a Lambda function need to be created on the Amazon
S3 site. The trigger is run when specific actions occur within a bucket and the source bucket items
with their metadata are imported to the archive bucket. Merge1 will then capture the data from the
archive bucket.
71
Merge1 | User Guide
IMPORTERS
To capture data stored from different sources in Azure Blob storage, Azure storage should be
configured accordingly. For more information on how to configure Azure Storage, see the Configuring
Azure Storage section.
Merge1 will then capture the stored data from the storage.
For File Filter a wildcard can be used to denote the file types to be included or excluded. Each type of
filter is separated by the vertical pipe character |. For example: *.tar.gz | “.txt.
72
Merge1 | User Guide
IMPORTERS
73
Merge1 | User Guide
IMPORTERS
2. Make sure the connection settings match those of the SFTP server. Enter the Path to the
required folder.
3. For Authentication, enter the Username provided by the source.
4. Click the Import Private Key button and Import SSH Key will open.
5. Copy and paste the Private Key.
6. Click Import and the Public Key field will be populated automatically.
PGP Configurations
For PGP configurations:
1. Enable the Use PGP Decryption checkbox and PGP Decryption Options will be opened.
74
Merge1 | User Guide
IMPORTERS
2. Click IMPORT PRIVATE KEY. The Import PGP Private Key window will appear.
3. Enter the Password of the Private key if it is encrypted with a password.
4. Enter Private Key and click Import.
5. Log into your source control panel and enable PGP encryption by adding Merge1 Keys.
6. In your source control panel, click Add and the Add Public Key window will appear. From the
Key Type drop-down menu, select Encryption and paste the full contents of the public key
(including the block header and footer) under the Public Keys tab at control panel in your
terminal.
7. Click the Decryption button. (The key appears in the Public Keys section). To save the PGP
encryption key to your account, click Submit.
8. Enter the Password of the Private key if it is encrypted with a password.
9. Enter the Imported Public Key.
Folder Configurations
Merge1 Folder is a required setting option. In case you miss to fill in the information, you will not be
allowed to proceed to the next screen.
After successfully setting up the FTP and PGP Configurations, you will have to change the folder
configurations. In Merge1 you will have to specify the Import folder, where you can store the data
after retrieving it from Amazon S3, as well as Quarantine folder where all the failed messages will be
archived.
If you have subfolders under your Import folder, you can enable Traverse subdirectories to maintain
the subfolder structure of imported data and include the data in your Yieldbroker Merge1.
75
Merge1 | User Guide
IMPORTERS
Figure 107: Folder Configuration
Under After Successful Importing settings, you can provide Merge1 what to do with the original files.
You can either Move the original files in a subfolder within an Importer Folder or you can Delete the
files. Note that once deleted, the files cannot be recovered.
The files in Quarantine folder are not automatically reprocessed. During the next import, the same
files from the FTP server or Import folder will be checked and, in case they are available, will be
reprocessed.
Miscellaneous Settings
If you want to import specific files or filetypes, note them in the Files to import form. You can
separate each file or filetype with a vertical bar I. Simply write the name of the file or use wildcards to
import the whole filetype) (e.g., *.txt | *.xml). The default setting formats is *.csv as Amazon S3
parses messages with these source files.
The Subject Prefix is added to the subject line of imported emails. This is useful for organizing
imported data especially when multiple sources share a common target.
Timestamp Formatting
In addition to the primary stamp, a second timestamp can be enabled with its time zone. From the
drop-down menu you can choose the time zone of the timestamp.
The format of the timestamp in the output message can also be specified from the six options in the
Date time Format drop-down list.
76
Merge1 | User Guide
IMPORTERS
Attachment Validation
Merge1 enables you to develop customized notes for attachment validation. The default setting is
Fail Messages with missing Attachments, as a result of which the messages that do not have
attachments are failed and can be viewed under the Reports. Note that Advanced Processing should
not be selected for this to happen.
If you select the Replace all the attachments with the following note and input your custom note, all
the attachments to the messages will not be processed and in their place the input note will be added
to the message.
If you select the Replace missing attachments with the following note and input your custom note, all
the missing attachments of the messages will not be processed, and you will see only the custom
message that you have entered.
77
Merge1 | User Guide
IMPORTERS
11. On the left side navigation pane, select Containers (1) and click the name of the container you
want (2).
78
Merge1 | User Guide
IMPORTERS
79
Merge1 | User Guide
IMPORTERS
AMAZON S3
Amazon S3 is an object storage service that offers industry-leading scalability, data availability,
security, and performance. It provides easy-to-use management features so you can organize your
data and configure access controls to meet your business, organizational, and compliance specific
requirements.
Activities Captured
• Folder activities - created/renamed
• Files and file operations - created (upload)/renamed/updated (by uploading another file with
the same exact name)
For Merge1 to capture Amazon S3 data, triggers and a Lambda function need to be created on the
Amazon S3 site. The trigger is run when specific actions occur within a bucket. And the source bucket
items with their metadata are imported to the archive bucket. Merge1 will then capture the data
from the archive bucket.
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• SSH Key Authentication
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
• Timestamp Formatting
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
80
Merge1 | User Guide
IMPORTERS
BLACKBERRY
The BlackBerry smartphone was once the most popular mobile device for enterprise use. Merge1
captures BlackBerry communications and stores them in existing email archive, whether on-prem or
in the Cloud.
Activities Captured
• Pin-to-pin
• Messenger
• SMS/MMS
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• PGP Configurations
• Folder Configurations
BlackBerry Options
The BlackBerry source can only process one format at a time. You have the following Collector Types
to choose from the drop-down list:
• P2P (default)
• SMS
• Messenger (BBM)
• Video chat
Once you have selected the Collector Type, you can also provide the Source Time Zone information.
Merge1 assumes that the messages in the source file are of the set time zone and based on that data,
the dates in the messages are processed to UTC time zone. By default, Merge1 sets the Source time
zone as Local timezone.
BlackBerry Filtering
Use BlackBerry Filtering configurations to determine which status types, subtypes, or commands are
imported (Figure 117). Separate each name with the following symbol: |. Note, that wildcards are
NOT supported for the following field. Each source type has different filtering options. P2P type can
be filtered with status types and commands. SMS sources can be filtering by all displayed options.
81
Merge1 | User Guide
IMPORTERS
Messenger type can be filtered only by commands. Video chats cannot be filtered at all. If you want
to process the whole data, leave all three fields blank.
Miscellaneous Settings
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
82
Merge1 | User Guide
IMPORTERS
BLOOMBERG
Bloomberg delivers business and markets news, data, analysis, and video to the world, featuring
stories from Business week and Bloomberg News. Bloomberg Vault is a hosted end-to-end
information management service that delivers compliance and IT solutions by leveraging the
scalability and reliability of Bloomberg’s global infrastructure.
Activities Captured
• Disclaimers (.dscl)
• Instant Bloomberg Messages (.ib), attachments (.att)
• Email Messages (.msg), attachments (.att)
Notes
• To process current schema files, the file filter should be configured with the following
extensions: *.ib19.*.xml.gpg | *.msg.*.xml.gpg | *.dscl.*.xml.gpg | *.ib19.att.*.tar.gz.gpg |
*.msg.att.*.tar.gz.gpg.
• Quarantine sources column on the Dashboard shows the number of the files moved to the
quarantine folder while processing source files with the below listed configured formats. All
other files have initially been considered unwanted files and have been moved to the
quarantine folder.
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• SSH Key Authentication
• PGP Configurations
• Folder Configurations
Bloomberg Options
83
Merge1 | User Guide
IMPORTERS
• Advanced Reprocessing - For more details see Advanced Reprocessing: Attachment Validation
and Advanced Reprocessing: Disclaimer Validation.
• Use Legacy Bloomberg Importer style of date processing - Merge1 will scan the date and time
stamp of dump files and assume their time zones correspond with those of the device on
which Merge1 is running (recommended for dump files created before March of 2009).
If this option is not selected, Merge1 will assume that date processing should be
accomplished based on the Universal Time Coordinated (UTC) time zone, which is used for all
current Bloomberg files. However, Bloomberg files created before March 2009 will be
processed successfully, even if this option is not selected (selection, however, is
recommended).
• Full attachment validation - If enabled, the entire source (file group) will be quarantined, in
case the attachment of a message is missing or corrupted, i.e., the Fail messages with missing
attachments under Attachment Validation will be ignored. If disabled, the selection under
Attachment Validation will be applied to the messages that are missing attachments.
• Full disclaimer validation - If enabled, the entire source (file group) will be quarantined, in
case the disclaimer of a message is missing or corrupted, i.e., the Fail messages with missing
disclaimers under Disclaimer Validation will be ignored. If disabled, the selection under
Disclaimer Validation will be applied to the messages that are missing disclaimers.
• Split IB Conversations by day - If checked messages with the same UTC Day will be imported
in one message.
• Max IB Message Size: (MB) - When this option is checked and the maximum size is set, the
messages with larger message size will be split. Note that attachments with larger size will not
be split.
• For IB: use EndTime as SentTime instead of StartTime - The SentTime in the imported
message of IB source files will be replaced with the EndTime of the message, instead of
StartTime. See the examples below.Note that if Split IB Messages by day is enabled,
DateTimeUTC is prioritized.
• For MSG: exclude TO, CC and BCC data from message body - When this option is checked, TO,
CC, and BCC data of the source MSG message is removed from the body of the message.
• For IB: Easy Review Mode - When this option is checked, Participant Entered and Participant
Left events are shown in a separate table at the bottom of the message.
• For IB: Ignore Historical Data - When this option is checked, there will not be any historical
events from prior days.
• For IB: Ignore Data with History Tag - When this option is checked, data with “History” tag will
be ignored.
84
Merge1 | User Guide
IMPORTERS
Note that in the below examples the timestamps in the body message are UTC, while the SentTime of
the generated output is UTC +4. The SentTime of the message is adjusted to the time zone of the
device it is opened on.
Also note that the mapping of SentDate (10:26 PM) can be changed using the "For IB: use EndTime as
SentTime instead of StartTime" checkbox.
If For IB: use EndTime as SentTime instead of StartTime is enabled the SentTime of the
generated email is shown the same as the EndTime of the message:
Advanced Reprocessing is for processing messages that failed because of either missing attachments
or disclaimers.
85
Merge1 | User Guide
IMPORTERS
If Advanced Reprocessing and Full Attachment Validation is enabled and Fail Messages with missing
Attachments is selected, the following happens:
In case an attachment file is either missing or corrupted, Merge1 starts processing the source files
and quarantines them due to missing attachment. When running the next import, on condition that
the missing attachment is available now, Merge1 successfully processes all the files. This way Merge1
processes the messages previously quarantined just like any new complete file group.
If Advanced Reprocessing and Full Disclaimer Validation is enabled and Fail Messages with missing
Disclaimers is selected, the following happens:
In case disclaimer file is either missing or corrupted, Merge1 starts processing the source files and
quarantines them due to missing attachment. When running the next import, if the missing disclaimer
is available now, Merge1 successfully processes all the files. So, Merge1 processes the messages
previously quarantined just like any new complete file group.
Attachment Validation
Merge1 enables you to develop customized notes for disclaimer validation. The default setting is Fail
messages with missing disclaimers, so the messages that do not have disclaimers are failed and can
be viewed under the Reports. Note that Advanced Processing should not be selected for this to
happen.
86
Merge1 | User Guide
IMPORTERS
If you select the Replace all disclaimer with the following note and input your custom note, all the
disclaimers will not be processed and instead of them the input note will be added to the message.
If you select the Replace missing disclaimers with the following note and input your custom note, all
the missing disclaimers will not be processed and instead of them the input note will be added to the
message.
Select the email address type you would like Merge1 to use when processing data from users that
have both their personal email address and their corporate email address registered on Bloomberg.
In case Both email addresses is selected, you can make either the Bloomberg or Corporate email
address primary by clicking the corresponding button.
IB Message Body
In the Bloomberg collector, you can choose from the following IB message body options:
1. Plain mode
2. Grid mode |Select style
3. Light grid mode
When you select Plain mode option (default) you will see the interactions below each other. Plain
mode displays the message in its basic form.
87
Merge1 | User Guide
IMPORTERS
If you enable Grid mode option, you will see the information in the following columns:
• Interaction Type, which contains information about participants and messages, such as
Participant Entered, Participant Left, Participant Invited, Message, Attachment.
• Date, which shows the date and time the message was sent.
• User Info, where you can view the user's Full Name (Company Name) <Email Address>
• Content.
• Device Type, if the message was sent from a mobile device, it will be displayed as M in that
field.
When you select the Light grid mode, the data is two-toned an easy to be viewed with limited
metadata.
88
Merge1 | User Guide
IMPORTERS
Miscellaneous Settings
An ideal technique for processing Bloomberg's firm-level files is to set Ignored Target as the default.
Then a filter should be configured to match segments for the necessary account numbers and route
them to a secondary target, and likewise, another filter to match segments to account numbers that
are unnecessary and route them to a Failed Target.
This way, new account numbers can be discovered using the reporting feature in the Importer's
settings (Reporting). Unconditional hit default target and Process all filters must be disabled
(Filtering).
However, if you intend to set other Targets for your importer, click the exact target type to see how it
is set up.
There are mainly two reasons that cause a file to become quarantined. The first occurs when a file
cannot be parsed, or in simpler terms, the file format is incorrect. The second reason is caused by an
IB (instant messages) or an MSG (message) file that is missing attachments or disclaimers. To address
these quarantine files, the client will typically ask Bloomberg to resupply the ATT (attachments) or the
DSCL (disclaimer) files. Once provided, the corrected file including the IB and MSG file (the file that
was quarantined) will need to be added into the IMPORT folder (the name of this folder is decided at
the time of configuration by the client). Once the importer starts again, this information will be
reprocessed. This is the way the reprocessing works if Full Attachment/Disclaimer Validation and
Advanced Reprocessing are not enabled.
89
Merge1 | User Guide
IMPORTERS
Another option is to ignore the missing attachments and disclaimers. Messages can be processed
without attachments. For this, Full Attachment/Disclaimer Validation should be enabled, and the
default settings set to Replace missing attachments/disclaimers with the following note. This option is
only set if there is no interest in the missing attachment/disclaimer of a message and only a reference
to the missing file name is enough. Choosing this option will create a reference for the missing
attachment within the messages once delivered to the target.
Next Steps
After setting up the collector, follow the links below to continue with configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
90
Merge1 | User Guide
IMPORTERS
BOX
Box platform is a cloud content management platform and can be accessed using the Box Content
API. Box platform provides a suite of cloud content services that lets build content apps quickly.
Activities Captured
• Uploads
• Downloads and task assignments1
• Comments
• Box quick notes (in Box generated special format)
• New version upload (in the message subject, event type is displayed as edited)
• Task completed/rejected (displayed in the message body as task deleted)
• Comment deletion
• Move/Copy/Edits (only Box quick notes)/Preview/Rename
• Report export
Note
Original files are attached for all the events unless the files have been deleted previously. In that case,
the message about the captured event will include information about the deleted file.
1
During the first run we will only get folder structure.
91
Merge1 | User Guide
IMPORTERS
4. Select the User Authentication (OAuth 2.0) method, enter the name of the app in the App
name field, and click Create App.
5. Go to the Configuration section, copy, and save Client ID and Client Secret.
92
Merge1 | User Guide
IMPORTERS
Collector Configuration
For configuring the Box application on the Merge1 site:
1. After entering a Name and a Description (optional) for the collector and then selecting the
collector from the list, in the Application ID field, add the Client ID copied previously, and in
the field of Application Secret/Key, enter copied Client Secret, click NEXT.
93
Merge1 | User Guide
IMPORTERS
Figure 135: Providing Credentials
2. Grant access to Box in the opened pop-up window. Make sure that pop-ups are not blocked
by your browser.
94
Merge1 | User Guide
IMPORTERS
downloaded. Data outside that timeframe will be ignored. Note that both options can be
used independently as well.
Next steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
95
Merge1 | User Guide
IMPORTERS
CHATTER
Chatter is an enterprise collaboration platform from Salesforce, a cloud-based customer relationship
management (CRM) vendor.
Merge1 Chatter collector needs to log into the Salesforce account with an Admin user and get user
personal token to import data. Besides, triggers need to be published on the Chatter site to be able to
capture updates, deletions, and edits. The triggers will create a post in a channel and Merge1 will
capture the information from the channel. For more information on triggers, see Installation
Instructions document listed in the References.
Merge1 supports Shield Platform Encryption without any additional configuration in Merge1, since
the data is encrypted by Salesforce "At rest" and the API provides the data decrypted.
Activities Captured
• Posts
• Files
• Comments
• Shares (including group posts)
• Comments of shared posts
• Deletes (requires triggers)
• Edits (requires triggers)
• Links
• Polls
• Private chats
• Group chats
• Feed poll choices (If Modify all data permission is enabled)
• New event/task contact/opportunity/case/lead
• All online communication, including attachments and deleted information (if the triggers are
set)
96
Merge1 | User Guide
IMPORTERS
1. Login to Salesforce using an account that has the System Administrator profile and switch to
Salesforce Classic (if you are using the Lightning Experience).
3. Find the Read Only profile and click the Clone button.
97
Merge1 | User Guide
IMPORTERS
4. Enter a Name for in the Profile Name field and click the Save button.
5. Click Edit.
98
Merge1 | User Guide
IMPORTERS
2. Populate the required fields and select Salesforce as User License, and the profile will be
created as in Figure 143 (in this case the profile name is Merge1), then scroll down and click
Save.
99
Merge1 | User Guide
IMPORTERS
1. Click your Username at the top right corner of the screen and select My Settings.
2. In the navigation pane to the left, under the Personal section, choose Reset My Security
Token, then click Reset Security Token. The new token will be sent to the email associated
with your account.
100
Merge1 | User Guide
IMPORTERS
If you want to enable Merge1 to collect deleted or updated comments and posts in Chatter, ask your
Salesforce administrator to perform the following steps in the Chatter UI:
1. Create a new Private Group ensuring they do not automatically archive this group and the
Private option and the Broadcast Only checkbox are selected.
101
Merge1 | User Guide
IMPORTERS
Collector Configuration
For Chatter configuration:
1. Enter the Username and Password of the Chatter Admin account used for app creation.
2. Enter the previously copied Security Token.
3. Specify the days for messages that should be processed.
102
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
103
Merge1 | User Guide
IMPORTERS
Merge1 supports Shield Platform Encryption without any additional configuration in Merge1, since
the data is encrypted by Salesforce "At rest" and the API provides the data decrypted.
Activities Captured
• Posts
• Files
• Comments
• Shares (including group posts)
• Comments of shared posts
• Deletes (requires triggers)
• Edits (requires triggers)
• Links
• Polls
• Private chats
• Group chats
• Feed poll choices (If Modify all data permission is enabled)
• New event/task contact/opportunity/case/lead
• All online communications, including attachments and deleted information (if the triggers are
set)
Collector Configuration
For Chatter configuration:
1. Specify Host.
2. Enter the Username and Password of the Chatter Admin account used for app creation.
3. Enter the previously copied Security Token.
104
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
105
Merge1 | User Guide
IMPORTERS
Activities Captured
• Direct messages during a call
• Persistent chats and channels
• Group members in a group or persistent chat
• Attachments
• Emojis
• Edited messages
• Deleted messages
• Conversations related to all newly added users
• Message threading/post threading/group chats threading
Notes
• The Webex environment allows inviting users from the other networks/domains (i.e., external
users). These users can then create groups and teams like internal users. The chats/teams
created by the External users are stored outside of the internal domain, i.e., in the Consumer
organization storage. Consumer Organization owns this space. So, the data in the external
domain are not captured by the collector.
• Deleted attachments are not captured due to API temporary limitations.
106
Merge1 | User Guide
IMPORTERS
Note that the account should have the Full administrator permission and be a Compliance Officer.
Permissions for full administrator privileges can be checked at https://admin.webe.g.com/users >
Select User > Administrator Roles under Organization Administrator Roles and Functional
Administrator Roles accordingly.
2. When you are logged in and permissions are set, click Start Building Apps.
107
Merge1 | User Guide
IMPORTERS
108
Merge1 | User Guide
IMPORTERS
• spark:all
• spark-admin:license_read
• spark-admin:organizations_read
• spark-admin:people_read
• spark-admin:roles_read
• spark-compliance:events_read
• spark-compliance:memberships_read
• spark-compliance:messages_read
• spark-compliance:rooms_read
• spark-
compliance:team_memberships_read
• spark-compliance:teams_read
Collector Configuration
To configure the collector:
1. Add the Client ID into Application ID field.
2. Fill in Application Secret/Key with the Client Secret.
3. Click NEXT.
109
Merge1 | User Guide
IMPORTERS
The format of the timestamp in the output message can also be specified from the six options in the
Date time format drop-down list.
Miscellaneous Settings
• The Subject Prefix is added to the subject line of imported emails. This is useful for organizing
imported data, i.e., when multiple sources share a common target.
• If the option Merge Messages by Thread is enabled, Merge1 retrieves the data from a thread
and archives it as one message.
• Select the time zone by which the messages from the drop-down menu.
• Options Do not download data modified before and Do not download data modified after
allow cutting off data outside the set date range. If the before date is set to 08/17/2022 and
the after date is set to 08/25/2022, only the data between these two dates will be
downloaded. Data outside that timeframe will be ignored. Note that both options can be
used independently as well.
110
Merge1 | User Guide
IMPORTERS
Attachments Configuration
• When Do not download files greater than X megabyte(s) is selected, the files bigger than the
filled-in number of megabytes, are not downloaded. In this Custom Message field, a text for
those excluded files can be specified. For example: “Files {0} are not imported, because they
are greater than {1) megabytes”. {0} is used to add the name of the file and {1} is used to add
the number of megabytes specified above.
• In the File Types field the types of files that should not be downloaded can be specified in the
following format: e.g., .txt | .xml. The vertical bar is used to separate the file types.
Note that in case of using file filtering by size and by type we recommend using custom messages.
111
Merge1 | User Guide
IMPORTERS
Split Message
Check the Split messages box in case you want to split big files into smaller files. The size of a split part
of the message can be specified so that each part does not exceed the set size.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
112
Merge1 | User Guide
IMPORTERS
Activities Captured
• Files - uploaded/deleted1/archived/renamed/downloaded/viewed2/shared3/moved/checked
in/out
• Folders - created/moved4/shared/deleted
• Login info
• Share file requests
• Text-only messages
• Share file request message
We recommend using the owner account for authentication. Note that activities performed by the
user of the Org. Owner account are not captured.
Notes
• We can upload several files with the same name in File Box. The generated report contains
only path info for the uploaded files, which is the same for all the items having the same
name. Hence, Merge1 attaches the same file (generally, the latest among the ones with the
same name) to all the generated messages.
• If files having the same name are downloaded, in all the generated messages we will have the
same file attached. The reason for this issue is the same, as for the File upload.
• If the file is permanently deleted/archived, the activity is not captured.
• In case files are sent via Outlook and the shared information is not recorded in the Citrix
environment, the captured message will have an empty body.
113
Merge1 | User Guide
IMPORTERS
Granting Permissions
To be able to capture data, Org Owner must give the Access other users’ File Boxes and Sent Items
specific permission. To give the permission:
1. Navigate to your ShareFile instance.
2. Log into your Citrix ShareFile Org Owner account.
3. Go to People > Browse Employees.
114
Merge1 | User Guide
IMPORTERS
6. In the Files and Folder sub-section, enable the Access other users’ File Boxes and Sent Items
checkbox.
Collector Configuration
To configure the collector:
1. In the Application ID field, fill in the copied Client Id.
2. In the Application Secret/Key field, fill in the copied Client Secret.
3. Add subdomain of the ShareFile workspace into the SubDomain field. (SubDomain is located
under Admin settings > Company info > Edit company Branding).
115
Merge1 | User Guide
IMPORTERS
4. In the opened window, enter your accounts subdomain, and then sign into ShareFile account.
Make sure that pop-ups are not blocked by the browser. This can be checked from the top
right corner of the address field.
Activities to Be Processed
It is possible to choose which activities Merge1 processes from Citrix Workspace & ShareFile.
116
Merge1 | User Guide
IMPORTERS
• Archive only ShareFile shared files: Only shared files are imported.
• Archive all activities in ShareFile: All activities are captured and imported.
• Archive only certain selection of activities in ShareFile: Activities to be captured and imported
can be selected separately from the list below:
o Upload
o Download/View
o Folder create
o Check in/Check out
o Edit
o Delete/Archive
o Login
o Move
o File share
o Share file requests
o Text-only messages
117
Merge1 | User Guide
IMPORTERS
Attachments Configuration
For more information on how to configure attachments, see Attachments Configuration.
Note when the Ignore Attachments checkbox is checked, all the attachments are being excluded from
the message which will enhance the collector performance. Each message will contain only
information and the link of the excluded attachment.
In case of using file filtering by size and by type, we recommend using custom messages.
Next Steps
After setting up the collector, follow the links below, to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings.
118
Merge1 | User Guide
IMPORTERS
CROWD COMPASS
Crowd Compass creates custom-branded mobile event apps for upcoming events or conferences.
Event managers can communicate with Attendees.
Merge1 captures data from the Crowd Compass using an API. The connection is established using an
Access Token. The access token provided by Crowd Compass support corresponds to an Event Center
user. The token will be able to access any event that the user does i.e., if you are an event admin for
the Sandbox event only, and can’t see any other events in the account, your access token will not be
able to make API calls to the other events in the account.
Activities Captured
• ‘From’ details
• ‘To’ details
• Invitations
• Event IDs
• Messages
Collector Configuration
To configure the source, fill in the Access-Token for your Crowd Compass Configuration environment.
119
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings.
120
Merge1 | User Guide
IMPORTERS
DB
Merge1 DB collector is designed as an open SDK platform to allow our customers to rapidly import a
table or part of the table from an MS SQL or Oracle Database. With the DB source you can collect and
process data from a table from any MS SQL database.
The objective of the collector is to map the columns of the table to specific email required fields
format. We are looking to map the "Sender", "To", "Title", "ActivityDateTime", "Content" fields to
appropriate columns in the text delimited file. Merge1 keeps a history of data imported to make sure
the same data is not re-imported (note multiple columns could be added to the body of the email).
With the DB source you can collect and process data from any database. To do so, use XML mapping
(see XML Mapping Sample).
Upload the XML file containing your formatting preferences and click Next. And by clicking the
Download button in the collector configuration wizard, download a DB configuration and mapping
XML file.
121
Merge1 | User Guide
IMPORTERS
To connect to the relevant database, use a sample code idea presented below:
<ConnectionString>
Data Source=.; Initial Catalog=MyDb;Integrated Security=True;
</ConnectionString>
<ConnectionString>
Data Source=(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)
(HOST=192.168.10.253)(PORT=1540))
(CONNECT_DATA=(SERVICE_NAME=TestDb))); User ID = <username>; Password =
<password>;
</ConnectionString>
There can be as many <ColumnMetaInfo> tags as there are columns in the source table.
There should not be any duplicates. Names are not case-sensitive.
122
Merge1 | User Guide
IMPORTERS
There can be as many <ColumnMapping> tags as it is necessary. These columns can be reused
in any way. <ColumnName> may contain multiple string tags only if the <MessagePropertyName>
allows for multiple entries (see below). If multiple entries are present, the contents are sequenced in
order with spaces.
Valid <MessagePropertyName> values are not case sensitive and are as follows:
Custom fields may be used with multiple values and are added to each message as custom properties.
<DataType> and <Nullable> tags are semantic and are not mandatory.
Merge1 DB Collectorsupports the following data type values that can be collected from the database:
varchar, nvarchar, ntext, int, tinyint, longint, and datetime.
Sender, To, CC, and BCC fields are set to SMTP addresses only, thus imported messages will show up
with empty fields.
Select the Set Display Name to SMTP address when empty option in Importer Settings under
Processing to avoid this.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
123
Merge1 | User Guide
IMPORTERS
DROPBOX BUSINESS
Dropbox Business is a cloud-based file storage system. It is a secure storage for all your tools, content,
and collaborators. This platform keeps your teams productive and your content safe by driving
transformation across industries.
Activities Captured
• Files and file operations - added/copied/deleted/downloaded/edited/moved/
permanently deleted/renamed/restored/reverted/rolled back
• Comments - added/deleted/edited
• Sharing:
o Shared content - add invitees/add members
o Shared content - copy, view, unshare
o Shared folder - create/mount/unmount
o Shared link - copy/create/download/view
There are some cases, such as events generated by external (anonymous) users, which are not
captured.
124
Merge1 | User Guide
IMPORTERS
4. Enable Choose an API: Scoped access and the type of access you need: Full Dropbox - Access
to all files and folders in a user's Dropbox.
125
Merge1 | User Guide
IMPORTERS
Note that both the App key and App secret must be provided to Merge1 as part of Dropbox Business
configuration.
7. On the Permissions tab, select the following checkboxes and click Submit:
• account_info.read: View basic information about your Dropbox account such as
your username, email, and country.
• files.metadata.read: View information about your Dropbox files and folders.
• files.content.read: View content of your Dropbox files and folders.
• sharing.read: View your Dropbox sharing settings and collaborators.
• file_requests.read: View your Dropbox file requests.
• team_info.read: View basic information about your team including names, user
count, and team settings.
• team_data.member: View structure of your team's and members' folders.
• members.read: View your team membership.
• groups.read: View your team group membership.
• events.read: View your team's activity log.
126
Merge1 | User Guide
IMPORTERS
Collector Configuration
1. In the Application ID field, add the App Key copied previously, and in Application Secret/Key,
enter the copied Secret, click NEXT.
127
Merge1 | User Guide
IMPORTERS
2. Grant Access to Box in the opened pop-up window. Make sure that pop-ups are not blocked
by your browser.
Attachments Configuration
For more information on how to configure attachments, see Attachments Configuration.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
128
Merge1 | User Guide
IMPORTERS
EML
The EML collector is used to process EML type files from various sources. EML format is widely used
by various compliance and archiving solutions and may help the organization avoid the need to
develop a specific-source parser. The EML collector is used for importing EML data from Symphony.
Files with md5 extension should be excluded from the import, as content from Symphony is exported
in a single Zip file containing EML files for each active conversation.
There are some drawbacks in using EML instead of Symphony collector for processing files from
Symphony. They include:
• EML does not have a subject line to do conversation threading when searching.
• EML has poorer look (XML to HTML looks better than EML).
• EML misses information about room created, when joined, etc.
Advanced Configuration
This section allows constructing a message based on:
• From
• Cc
• Subject
• To
• BCC
• Date
You can also specify a custom header (comma delimited) in the corresponding field.
Timestamp Formatting
For more information, on how to configure this section see Time Stamp Formatting.
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• SSH Key Authentication
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
129
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector follow the appropriate links below to continue with configuration
of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
130
Merge1 | User Guide
IMPORTERS
EWS
Exchange Web Services (EWS) is an application program interface (API) that allows programmers to
access Microsoft Exchange items such as calendars, contacts, and email. EWS, which first became
available in Exchange Server 2007, provides administrators with the flexibility to store, retrieve, move,
and modify email and related data for a single user, a group of users or an entire Exchange Server
organization on an Exchange server.
Activities Captured
- From Exchange:
• Messages
• Meeting requests
• Meeting cancellations
• Appointments
In Skype for Business Online, file transfers within Instant Messaging are considered a “non-archived
feature.” That means the feature is not captured when you have an In-Place Hold set up in Exchange.
Thus, the data you would send via file transfer does not get recorded, which can jeopardize
compliance. (Shared OneNote pages and PowerPoint annotations are also non-archived features.)
This option is controlled at the user level. In the Skype for Business Admin Center, under Users, you
will find the option for turning off non-archived features. You are supposed to select this option if you
are legally required to preserve electronically stored information.
131
Merge1 | User Guide
IMPORTERS
132
Merge1 | User Guide
IMPORTERS
6. On the Assigned tab, to select the members to assign the Admin role.
9. Add Legal Hold, ApplicationImpersonation, Mailbox Import Export, and Mailbox Search to
select the administrator roles that correspond to the Exchange features and services that
members of this role group should have permissions to manage and click OK.
133
Merge1 | User Guide
IMPORTERS
Legal Hold and Mailbox Import Export do not need to be enabled if Retention Policy is going to be
used. They should be enabled only in case In-Place Hold is used.
Impersonator user must have Mailbox Search permission if on the Monitored users tab ALL is selected
3. Add a Name and a Description for the policy and click Next.
134
Merge1 | User Guide
IMPORTERS
4. In the next screen you will be offered to choose the applications to apply the retention policy
to. You can either select Apply policy only to content in Exchange email, public folders, Office
365 groups, OneDrive, and SharePoint documents.
Once you choose the locations where the retention policy applies, click Next.
5. On the next screen, you can set the retention period of the messages along with other
options. Configure the settings so that they meet your compliance requirements and click
Next.
135
Merge1 | User Guide
IMPORTERS
6. Review the settings that you have chosen. If everything is correct, click Submit.
Note that it would take up to 1 day to apply the retention policy to the locations you chose.
136
Merge1 | User Guide
IMPORTERS
Creation of In-Place Holds in Exchange Online will be discontinued later this year or early next
year. As an alternative to using In-Place hold, please, use Retention Policy as described in
Setting Up Security and Compliance for Microsoft 365.
4. Provide a suitable Name and Description, click Next.
5. In-place Hold will not be available if you select Search all mailboxes. Select Specify mailboxes
to search and click the + sign. Add specific mailboxes (or distribution groups), then click Next.
137
Merge1 | User Guide
IMPORTERS
6. You can either choose to put all content In-Place Hold (not recommended) or define some
criteria (recommended).
• Select Filter based on criteria.
• Click select message types.
• Click Select the message types to search, check the Skype for Business items
checkbox and click Next.
7. Select Place content matching the search query in selected mailboxes on hold, and click Finish
after selecting either:
• Hold indefinitely
• Specify number of days to hold items relative to their received date.
138
Merge1 | User Guide
IMPORTERS
1. Login to the Azure Portal using the same credentials as for O365 (Global Admin).
2. Click Azure Active Directory at the top of the page and select App Registration from the left-
side navigation pane.
139
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Find and make a note your Application (client) ID and Directory(tenant) ID as this is needed
for configuring the collector in Merge1.
6. In the navigation pane to the left, go to Certificates & secrets.
140
Merge1 | User Guide
IMPORTERS
8. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
141
Merge1 | User Guide
IMPORTERS
2. Click Microsoft Graph, and in the opened pane select Application permissions.
142
Merge1 | User Guide
IMPORTERS
Collector Configuration
To configure the EWS collector:
1. Specify the URL for the EWS collector.
2. Select the required Exchange version from the drop-down list.
3. Choose if the import should be done by last modification date (DateTimeModified) or by
creation date (OriginalDateTime). The cut-off date options change accordingly.
4. Fill in the Mailbox Folder from where the data should be imported. If you have more than one
Mailbox Folder, separate each name with a semicolon (“;”).
5. To process data within all the folder, check All folders.
6. To process data within the subfolders of the specified mailboxes, check Include subfolders.
7. To search for the mentioned mailbox folders in the recovery route folders, check Load
recoverable items if the Exchange Version is not Exchange2007 Sp1.
143
Merge1 | User Guide
IMPORTERS
9. Provide Impersonator name and Password in case you select Basic Authentication.
Note that to use Basic authentication you should enable the Allow Basic authentication policy
by navigating to Computer Configuration> Administrative Templates > Windows Components
> Windows Remote Management (WinRM) > WinRM Client.
12. In case you activate Upload file (*.pfx), click the Select button to upload the certificate and
then provide X.509 Certificate Password.
144
Merge1 | User Guide
IMPORTERS
For step-by-step instructions on how to get Application ID, Tenant ID, and Thumbprint, see
Microsoft Azure App Creation and Creating a Certificate (Private and Public Keys) accordingly.
13. For Advanced Configuration Options - Do Not Download Data Modified/Created Before and
Do Not Download Data Modified/Created After, allow cutting off data outside the set date
range. If the before date is set to 08/17/2022 and the after date is set to 08/25/2022, only
the data between these two dates will be downloaded. Data outside that timeframe will be
ignored. Note that both options can be used independently as well.
14. Select the Message Class you would like Merge1 to import and then click Save.
A Message Class is an internal identifier that Microsoft Outlook and Microsoft Exchange utilize to
locate and activate forms.
There are the following Message Class types that Merge1 can import:
145
Merge1 | User Guide
IMPORTERS
Message Classes can be edited in Merge1.Collectors.Base.dll.config in the Bin folder within the Merge1
7.01 installation directory. Default path: C:\Program Files\Globanet Consulting Services\Merge1
7.0\Bin\Merge1.Collectors.Base.dll.config.
Progress Counter
The Progress counter to the right of the Status bar shows the progress of the collector in three stages:
When In-place hold is activated, a compliant copy of each message is saved in the Purges folder (in
addition to a copy saved in the user’s mailbox) and cannot be deleted from there. If Skype for
Business Archived message class is selected, data is captured from Purges folder.
When all 3 Skype for Business message classes are selected, duplicates can be captured, as copies are
kept both in the user mailbox and in the Purges folder. The only use case to get compliant data from
Skype for Business Online without duplicates is checking Skype for Business Missed and Skype for
Business Archived.
1
In case of Merge1 version 6.0, the path will be C:\Program Files\Globanet Consulting Services\Merge1
6.0\Bin\Merge1.Collectors.Base.dll.config.
146
Merge1 | User Guide
IMPORTERS
History Tracking
Based on the provided information, there is a chance to monitor a certain timeframe but get a
message with a timestamp that is out of the specified frame. This case is applicable when import is
based on DateTimeModified.
Next Steps
After setting up the collector, follow the links below to continue with configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
147
Merge1 | User Guide
IMPORTERS
Activities Captured
• Messages
• Meeting requests
• Meeting cancellations
1. Login to the Azure Portal using the same credentials as for O365 (Global Admin).
2. Click Azure Active Directory at the top of the page and select App Registration from the left-
side navigation pane.
148
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Find and make a note your Application (client) ID and Directory(tenant) ID as this is needed
for configuring the collector in Merge1.
6. In the navigation pane to the left, go to Certificates & secrets.
149
Merge1 | User Guide
IMPORTERS
8. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
150
Merge1 | User Guide
IMPORTERS
2. Click Microsoft Graph, and in the opened pane select Application permissions.
151
Merge1 | User Guide
IMPORTERS
Collector Configuration
After filling in the Name and Description on the Add Importer window and selecting the source on
Configuration Wizard:
1. In the new window opened, add Application ID, and Application Secret/Key.
2. Provide X.509 Certificate Thumbprint in case you activate the Local machine radio button as
the X.509 Certificate source.
3. In case you activate Upload file (*.pfx), click the Select button to upload the certificate and
then provide X.509 Certificate Password.
152
Merge1 | User Guide
IMPORTERS
11. For Advanced Configuration Options - Do Not Download Data Modified/Created Before and
Do Not Download Data Modified/Created After, allow cutting off data outside the set date
range. If the before date is set to 08/17/2022 and the after date is set to 08/25/2022, only
the data between these two dates will be downloaded. Data outside that timeframe will be
ignored. Note that both options can be used independently as well.
12. Select the Captured Activity type you would like Merge1 to import and then click Save.
There are the following activities that Merge1 can import:
Next Steps
After setting up the collector, follow the links below to continue with configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
153
Merge1 | User Guide
IMPORTERS
FX CONNECT
FX Connect is a market-leading FX execution venue that helps firms efficiently manage multiple
portfolios, connect with brokers, and streamline global operations. It provides users with tools to
manage pre- and post-trade workflows electronically, while also offering tools designed to help clients
carry out their compliance obligations.
The data from FX Connect should be imported to Merge1 in CSV format. Merge1 maps the columns of
the CSV file with the fields in the output message. Please note, that message participants by default
are imported in FX Connect User ID format. If you want to map them to the users’ email addresses,
each email address and corresponding FX Connect User ID should be added in User Mappings section
of collector set up.
Merge1 collector automatically merges messages with the same session ID into one output message.
Activities Captured
• Session ID
• Trade participants
• Messages
• Time stamps
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• SSH Key Authentication
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
Once you have selected the Collector Type, you can also provide the Source Time Zone
information. Merge1 assumes that the messages in the source file are of the set time zone and based
on that data the dates in the messages are processed to UTC time zone. By default, Merge1 sets the
Source Time Zone as UTC.
154
Merge1 | User Guide
IMPORTERS
FX Connect Options
The Merge messages by thread, if checked, combines messages by threads rather than sending them
one by one.
• LastName
• FirstName
• CompanyName
• FXUserID
• SMTP address.
Select Change the SMTP address and point to the location of the CSV. You can click Preview to see
how it looks and click Save.
Message Body
In the FX Connect collector you can choose between two message body options, which specify how
the imported message will be displayed in the target.
When you select the Plain Mode option, you will see the interactions below each other.
If you enable the Grid Mode option, you will see the information in the following columns:
155
Merge1 | User Guide
IMPORTERS
• Message creator
• Message timestamp
• Message
It is possible to change the color scheme of the grid mode by clicking the Select Style link.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
156
Merge1 | User Guide
IMPORTERS
GOOGLE DRIVE
G Suite’s Business and Enterprise editions provide flexible storage options so there will always be
enough space for the files. With centralized administration, data loss prevention, and Vault for Drive,
users and file-sharing can be easily managed to help meet data compliance needs. Drive is also
available as a standalone offering, with Drive Enterprise. Supported G Suite Plans are G Suite Business
and G Suite Enterprise.
In enterprise applications a user’s data might need to be accessed without any manual authorization
on their part. In G Suite domains, the domain administrator can grant third-party applications with
domain-wide access to its users' data — this is referred as domain-wide delegation of authority. To
delegate authority this way, domain administrators can use service accounts with OAuth 2.0.
Activities Captured
• Shared files
• Comments and replies of shared documents
The three items that will be needed later are service account’s:
• Client ID
• Private key file
• Email address.
157
Merge1 | User Guide
IMPORTERS
3. In the Create service account window, type a name for the service account. Note that the
next two steps are optional.
4. Once the service account is created, click it to open its settings. Open the Show Domain-wide
Delegation menu, check Enable Google Workspace Domain-Wide Delegation and click Save.
158
Merge1 | User Guide
IMPORTERS
5. In the same window, copy the Email and the Unique ID of the service account.
6. Go to KEYS and click ADD KEY, then select Create new key, to create a private key for the
service account.
8. Your new public/private key pair is generated and downloaded to your machine; it serves as
the only copy of this key. Keep it in a secure location.
159
Merge1 | User Guide
IMPORTERS
2. Scroll down to Domain wide delegation section and click Manage Domain Wide Delegation.
4. Open the key file that you saved in the above section, copy the value of client_id, then
paste it in the Client ID field. Enter the list of scopes that your application should be granted
access to. For example, if you need domain-wide access to Users and Groups enter
https://www.googleapis.com/auth/admin.directory.user.readonly and
160
Merge1 | User Guide
IMPORTERS
Your service account now has domain-wide access to the Google Admin SDK Directory API for all the
users of your domain. Now you can use Admin SDK Directory service object on behalf of your G Suite
domain's users.
Only users with access to the Admin APIs can access the Admin SDK Directory API, therefore
your service account needs to impersonate one of those users to access the Admin SDK
Directory API. Additionally, the user must have logged in at least once and accepted the G
Suite Terms of Service.
161
Merge1 | User Guide
IMPORTERS
162
Merge1 | User Guide
IMPORTERS
6. To assign the role to a user, go to https://admin.google.com and click Users, then click the
user that you want to assign the role to.
163
Merge1 | User Guide
IMPORTERS
11. Search and enable Admin SDK and Google Drive APIs.
164
Merge1 | User Guide
IMPORTERS
Collector Configuration
To authenticate the collector:
1. Upload the JSON of the public key saved to your device.
2. Enter the email address of the user created in the previous section.
Note that the Download button is activated when there is a JSON file uploaded.
Timestamp Formatting
For more information, on how to configure this section, see Time Stamp Formatting.
165
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
166
Merge1 | User Guide
IMPORTERS
ICECHAT
ICE Chat robust messaging system offers collaboration with other market participants. It offers
diverse setup options that can be tailored to support user’s compliance requirements. With IceChat
users can react to trade opportunities in real-time with features including quote and trade recognition
logic, blast messages and a marketplace directory connecting over 80,000 market participants.
Activities Captured
• Room ID
• Start time
• Message content
• Participants
• Participants entered
• Message date
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• SSH Key Authentication
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
Optional Settings
• When Bloomberg Vault Format is selected, the imported messages are displayed in
Bloomberg Vault format.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
167
Merge1 | User Guide
IMPORTERS
JABBER ENTERPRISE
Cisco Jabber is a suite of Unified Communications applications that allow seamless interaction with
your contacts from anywhere. Cisco Jabber offers IM, presence, audio and video calling, voicemail,
and conferencing. The applications in the Cisco Jabber family of products are:
Activities Captured
• Messages between individuals
• Groups chats
• Persistent chats
• File shares2
Cisco Jabber database design does not support storing Unicode characters, so messages that include
Unicode characters are not stored in the database, hence, cannot be captured by Merge1.
Collector Configuration
Merge1 retrieves data directly from Jabber’s database. You can select from the following three types:
• PostgreSQL Server
• Microsoft SQL Server
• Oracle Database
PostgreSQL Connection
To connect to Jabber enterprise database through PostgreSQL:
1. Select the database that you want to connect by clicking the respective button.
1You need to add all databases, from where to retrieve the data. Use the + button to add the databases.
2This feature is only supported in the environments where the Managed File Transfer feature is used in the Cisco Unified Communications
Manager IM and Presence Node. For more information see
https://www.cisco.com/c/en/us/td/docs/voice_ip_comm/cucm/im_presence/configAdminGuide/10_5_2/CUP0_BK_CEB3E82E_00_config-
admin-guide-imp-1052/CUP0_BK_CEB3E82E_00_config-admin-guide-imp-1052_chapter_010110.html
168
Merge1 | User Guide
IMPORTERS
2. For PostgreSQL:
• Enter the Configuration name.
• Select the PostgreSQL Server.
• Enter the Port and the Database name.
169
Merge1 | User Guide
IMPORTERS
• Min Pool Size - the minimum number of requests the application may process
concurrently.
• Max Pool Size - the maximum number of requests the application may process
concurrently.
• Network Packet Size - the fixed-size chunk of data that transfers requests and results
between clients and servers. This field specifies in what file-size chunks the file data
should be transferred.
• Enlist - when enabled, checks whether the SQL Server connection pooler
automatically enlists the connection in the creation thread's current transaction
context.
• Pooling - if enabled keeps the database connection session active so that when a
connection is later requested, one of the active sessions is used in preference to have
to create another one.
6. File Processing -By activating Process Shared Files checkbox, which is disabled by default, you
allow the files shared, using Jabber, to be processed by the collector and the fields below
become mandatory.
7. Fail conversations with missing files - When enabled, conversations that have reference(s) to
file(s) in the database but do not exist in the file store will be marked as failed (Stored in
Merge1 database), the Merge1 admin then can export the messages or set the reprocessing
option by navigating to the REPORTS page of Merge1.
8. Connection. Enter the host name of the remote SFTP server that is connected to the CUCM
IM and Presence server's MFT service and the folder path in the Host and Path text boxes,
respectively.
9. Authentication - To authenticate an SFTP connection, enter the username of the MFT server
user and import the private key of the user. You can also generate a new key pair, then add
the public key to the authorized_keys file of MFT server user. For more information,
regarding SSH key authentication, contact your Jabber and Linux teams.
Important Note: For MFT records CUCM allows the assignment of a database different than
the compliance database, as we do not support this setup. The database used for compliance
and MFT must be the same.
10. For Other Options:
• The Do not download data modified before will ensure that old or irrelevant data is
excluded. For example, if the date selected is 8/1/2022, it will not retrieve any data
modified before August 1 of 2022. Only the data after 8/1/2022 will be retrieved,
archived, and imported.
Oracle Server
To connect through Oracle:
1. For Oracle Connection fields:
• Specify a Configuration Name.
• Specify Oracle Server IP address and Port.
• In the SID field, add your Oracle SID, the Unique name that uniquely identifies your
instance/database. Or choose to add a Service Name of the Oracle Database instead.
• Add the name of your database schema in the Schema field.
• Add the Login and Password.
2. For Advanced Connection Parameters:
170
Merge1 | User Guide
IMPORTERS
• Min Pool Size is the minimum number of requests the application may process
concurrently.
• Max Pool Size is the maximum number of requests the application may process
concurrently.
• Enlist, when enabled, checks whether the SQL Server connection pooler automatically
enlists the connection in the creation thread's current transaction context.
• Pooling, if enabled keeps the database connections active so that when a connection
is later requested, one of the active ones is used in preference to have to create
another one.
• In the Connection Timeout field, the time during which the query is not processed
can be specific to yield timeout.
3. File Processing - By activating Process Shared Files checkbox, which is disabled by default, you
allow the files shared, using Jabber, to be processed by the collector and the fields below
become mandatory.
4. Fail conversations with missing files - When enabled, conversations that have reference(s) to
file(s) in the database but do not exist in the file store will be marked as failed (Stored in
Merge1 database), the Merge1 admin then can export the messages or set the reprocessing
option by navigating to the Reports page of Merge1.
5. Connection. Enter the host name of the remote SFTP server that is connected to the CUCM
IM and Presence server's MFT service and the folder path in the Host and Path text boxes,
respectively.
6. Authentication - To authenticate an SFTP connection, enter the username of the MFT server
user and import the private key of the user. You can also generate a new key pair then add
the public key to the authorized_keys file of MFT server user. For more information,
regarding SSH key authentication, please contact your Jabber and Linux teams.
Important Note: For MFT records CUCM allows the assignment of a database different than
the compliance database, we do not support this setup. The database used for compliance
and MFT must be the same.
7. For Other Options:
• The Do not download data modified before check will ensure that old or irrelevant
data is excluded. For example, if the date selected is 8/1/2022, it will not retrieve any
data modified before August 1 of 2022. Only the data after 8/1/2022 will be
retrieved, archived, and imported.
171
Merge1 | User Guide
IMPORTERS
172
Merge1 | User Guide
IMPORTERS
• Pooling - if enabled keeps the database connection session active so that, when a
connection is later requested, one of the active sessions is used in preference to have
to create another one.
• Replication is a technique through which an instance of a database is exactly copied
to, transferred to, or integrated with another location. Database replication is done
to provide a consistent copy of data across all the database nodes. It also removes
any data redundancy, merging of two databases into one and updating secondary
databases with outdated or incomplete data.
4. File Processing - By activating Process Shared Files checkbox, which is disabled by default, you
allow the files shared, using Jabber, to be processed by the collector and the fields below
become mandatory.
5. Fail conversations with missing files - When enabled, conversations that have reference(s) to
file(s) in the database but do not exist in the file store will be marked as failed (Stored in
Merge1 database), the Merge1 admin then can export the messages or set the reprocessing
option by navigating to the REPORTS page of Merge1.
6. Connection. Enter the host name of the remote SFTP server that is connected to the CUCM
IM and Presence server's MFT service and the folder path in the Host and Path text boxes,
respectively.
7. Authentication - To authenticate an SFTP connection, enter the username of the MFT server
user and import the private key of the user. You can also generate a new key pair then add
the public key to the authorized_keys file of MFT server user. For more information,
regarding SSH key authentication, please contact your Jabber and Linux teams.
Important Note: For MFT records CUCM allows the assignment of a database different than
the compliance database, we do not support this setup. The database used for compliance
and MFT must be the same.
8. For Other Options:
• The Do not download data modified before check will ensure that old or irrelevant
data is excluded. For example, if the date selected is 8/1/2022, it will not retrieve any
data modified before August 1 of 2022. Only the data after 8/1/2022 will be
retrieved, archived, and imported.
173
Merge1 | User Guide
IMPORTERS
174
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
175
Merge1 | User Guide
IMPORTERS
JSON
JSON collector allows our customers to rapidly transform JSON files using JSON template files to a
predefined format. Once JSON is transformed, Merge1 processes the JSON file by generating the
required mapping fields and creating the configured output format (EML, JSON, etc.). The mapping
varies from source to source. Contact Veritas Technologies LLC Support for more details on the
mapping corresponding to the source you are going to use it for.
Activities Captured
• Participants: From, To, CC, and BCC
• Activity datetime
• Body message
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
176
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
177
Merge1 | User Guide
IMPORTERS
MICROSOFT TEAMS
Microsoft Teams is a chat-based workspace in Office 365 that integrates with the apps and services
teams use to get work done together. The Microsoft Teams developer platform makes it easy for you
to integrate your service, whether you develop custom apps for your enterprise or SaaS applications
for teams around the world.
Microsoft Teams provides the enterprise security and compliance features you expect from Office
365, including broad support for compliance standards, and eDiscovery and legal hold for channels,
chats, and files.
Activities Captured
• Chat messages
• Channel messages
• Chat/Channel info
• Mentions
• Attachments
• Emojis
Note that edits and deletes of messages in chats, private, and public channels are not captured.
Notes
We recommend you invite the external users you want to communicate with and contact them as a
guest user because Microsoft APIs does not allow capturing external users’ events through its APIs.
To be able to capture shared attachments, the user should be a global admin or have corresponding
permissions.
Note that in Microsoft Teams Chats and Private Channel Conversations2 chats of users who do not
have an Exchange Online mailbox also referred as On-Premises or Hybrid users, are captured only
when at least one of the chat participants has an Exchange Online mailbox and is a user monitored by
Merge1.
178
Merge1 | User Guide
IMPORTERS
Important Information
Each team in Microsoft Teams has a team site in SharePoint Online, and each channel in a team gets a
folder within the default team site document library. Files shared within a conversation are
automatically added to the document library, and permissions and file security options set in
SharePoint are automatically reflected within Teams.
Private chat files are stored in the sender’s OneDrive for the Business folder, and permissions are
automatically granted to all participants as part of the file-sharing process.
If you do not have SharePoint Online enabled in your tenant, Microsoft Teams’ users cannot share
files in teams. Users in private chat also cannot share files because OneDrive for Business (which is
tied to the SharePoint license) is required for that functionality. By storing the files in the SharePoint
Online document library and OneDrive for Business, all compliance rules configured at the tenant
level will be followed.
You can use a retention policy to retain chats and channel messages in Teams. Teams’ chats are
stored in a hidden folder in the mailbox of each user included in the chat, and Teams’ channel
messages are stored in a similar hidden folder in the group mailbox for the team. However, it is
important to understand that Teams uses an Azure-powered chat service that also stores this data,
and by default, this service stores the data forever. For this reason, we strongly recommend that you
use the Teams location to retain and delete Teams data. Using the Teams location will permanently
delete data from both the Exchange mailboxes and the underlying Azure-powered chat service. For
more information, see more here: https://docs.microsoft.com/en-us/MicrosoftTeams/security-
compliance-overview.
Note that Teams’ chats and channel messages are not affected by retention policies applied to the
user or group mailboxes in the Exchange or Office 365 groups locations. Even though Microsoft
Teams chats, and channel messages are stored in Exchange, they are affected only by a retention
policy that has applied to the Teams location.
If a message is deleted and then the deletion is undone, all the other actions done on that
message will not be captured because the message will be absent from the mailbox.
179
Merge1 | User Guide
IMPORTERS
1. Login to the Azure Portal using the same credentials as for O365 (Global Admin).
2. Click Azure Active Directory at the top of the page and select App Registration from the left-
side navigation pane.
180
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Enter the enter the URL of your local Merge1 environment in the following format:
https://<your_merge1_domain>/Configuration/OAuthCallback. Click
Register.
6. Find and make a note your Application (client) ID and Directory (tenant) ID as this is needed
for configuring the collector in Merge1.
7. In the navigation pane to the left, go to Certificates & secrets.
181
Merge1 | User Guide
IMPORTERS
9. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
2. Click Microsoft Graph, and in the opened pane select Application permissions.
182
Merge1 | User Guide
IMPORTERS
4. Once you have selected all the checkboxes, click Update permissions.
5. Get back to API permissions section, click + Add a permission, select SharePoint and then
Application permissions. These are the permissions you need to grant:
1 Only required if the certificate has not been already uploaded to the Azure App.
183
Merge1 | User Guide
IMPORTERS
• Sites: Sites.Read.All
• TermStore: TermStore.Read.All
• User: User.Read.All
Once you have selected all the checkboxes, click Add permissions.
6. Add the Office 365 Exchange Online permissions (previously Exchange) - full_access_as_app;
MailboxSettings: MailboxSettings.Read.
184
Merge1 | User Guide
IMPORTERS
3. Add a Name and a Description for the policy and click Next.
4. In the next screen you will be offered to choose the applications to apply the retention policy
to. You can either select Apply policy only to content in Exchange email, public folders, Office
365 groups, OneDrive, and SharePoint documents. You should select the second option and
activate last two options - Teams channel messages and Teams chats. There is also an
opportunity to choose specific Teams/Users or Exclude them.
Once you choose the locations where the retention policy applies, click Next.
185
Merge1 | User Guide
IMPORTERS
5. In the next screen you can set the retention period of the messages along with other options.
Configure the settings so that they meet your compliance requirements and click Next.
6. Review the settings that you have chosen. If everything is correct click Submit.
186
Merge1 | User Guide
IMPORTERS
Note that it would take up to 1 day to apply the retention policy to the locations you chose.
Collector Configuration
After filling in the Name and Description on the Add Importer window and selecting the source on
Configuration Wizard:
1. In the new window opened, add Application ID, and Application Secret/Key.
2. Provide X.509 Certificate Thumbprint in case you activate the Local machine radio button as
the X.509 Certificate source.
3. In case you activate Upload file (*.pfx), click the Select button to upload the certificate and
then provide X.509 Certificate Password.
187
Merge1 | User Guide
IMPORTERS
4. You can copy the Application ID from the Azure Active Directory > App Registrations > <your
app name> section (Figure 299).
188
Merge1 | User Guide
IMPORTERS
Activities to Be Captured
You can specify activities to capture by the collector if no events are needed. Note that chats are
always captured.
Note
The message tracking (and cut-off date filtering) itself is being done by LastModifiedTime or
OriginalDateTime property (determined by the "Import Based On" setting of the collector ) of the
189
Merge1 | User Guide
IMPORTERS
message, as it is the most accurate way to ensure that no data (including edits) is missing, however,
the timestamp that is being printed in the headers of the message is the message creation timestamp
that we are retrieving from the ConversationXML (which becomes available only after filtering, thus, it
cannot be used before the message is retrieved).That timestamp is communicated by the source
vendor (Microsoft) as the only accurate timestamp.
• The Subject Prefix feature will add a prefix before the message subject to facilitate the search
in the target.
• Options Do not download data modified before and Do not download data modified after
allow cutting off data outside the set date range. If the before date is set to 08/17/2022 and
the after date is set to 08/25/2022, only the data between these two dates will be
downloaded. Data outside that timeframe will be ignored. Note that both options can be
used independently as well.
• The Merge Message by Thread if checked combines messages by threads rather than sending
them one by one.
• The message time zone by which the messages are split, can be selected from the drop-down
menu. When Process Incomplete Days option is enabled, the messages of the days that have
not yet ended will be imported in a separate email as well. This option can be selected only if
Merge Messages by Thread is selected.
• The feature Include detailed user information in the body of the message searches Azure AD
for user principal name and then add user display name and mail address from the Azure
Active Directory.
Attachments Configuration
For more information on how to configure attachments, see Attachments Configuration.
190
Merge1 | User Guide
IMPORTERS
Message Body
This specifies how the imported message will be displayed in the target. The Basic HTML mode
organizes the data in a simple way and data displayed in a Light Grid Mode is two-toned, easy to view
with limited metadata.
Note that in case of using file filtering by size and by type we recommend using custom messages.
Output sample:
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
191
Merge1 | User Guide
IMPORTERS
The Merge1 Microsoft Teams Meetings solution makes possible the collection of audio/video/screen-
sharing content generated during a Teams meeting.
• The first component is the Merge1 Microsoft Teams Meetings Bot, which makes possible for
a bot to automatically join and captures raw data from a meeting with every participant. This
component is deployed in the tenant Azure environment. The bot joins every type of
meeting, ad hoc or scheduled, accessing real-time audio and video streams, including desktop
and app sharing.
Note that this collector requires acquiring Microsoft Teams Meetings Bot to allow recording
and storing of audio/video content at the desired source. For more information, contact
Veritas Technologies LLC Support.
• The second component is the Microsoft Team Meetings Collector. The collector will obtain
the previously recorded calls and meetings by the bot, process the raw data, and send the
final version of the message to the desired location. (On-prem target; cloud target;
transcription tool)
Activities Captured
• Audio calls
• Video calls
• Screen share
• Meetings
Note
1. Login to the Azure Portal using the same credentials as for O365 (Global Admin).
192
Merge1 | User Guide
IMPORTERS
2. Click Azure Active Directory at the top of the page and select App Registration from the left-
side navigation pane.
193
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Find and make a note your Application (client) ID and Directory(tenant) ID as this is needed
for configuring the collector in Merge1.
6. In the navigation pane to the left, go to Certificates & secrets.
8. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
194
Merge1 | User Guide
IMPORTERS
2. Click Microsoft Graph, and in the opened pane select Application permissions.
Once you have selected all the checkboxes, click Grant Admin Consent.
Collector Configuration
After filling in the Name and Description on the Add Importer window and selecting the Source on
Configuration Wizard:
1. Add Directory (tenant) Id and Application Id.
2. Provide X.509 Certificate Thumbprint in case you activate the Local machine radio button as
the X.509 Certificate source.
195
Merge1 | User Guide
IMPORTERS
196
Merge1 | User Guide
IMPORTERS
11.
12. Figure 103: Import SSH Key
Click Import and the Public Key field will be populated automatically.
• Execute Script Against Source Files
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
Areas to Capture
By enabling the corresponding checkbox, you can capture the following content:
• Audio
• Video1
• Screen Share2
197
Merge1 | User Guide
IMPORTERS
The Audio checkbox is enabled by default, and the audio file is always included in the captured
message as a separate file.
Target Audience
To configure the target audience:
1. Enable Internal and external calls to allow capturing calls with both external and internal
users. Note that this option is enabled by default.
2. Enable External calls to capture only calls with the external users.
Note that guest access allows you to invite people from outside your organization to join a team.
Invited people get a guest account in Azure Active Directory and are considered as internal.
Attachments Configuration
1. The Include original data as attachment feature allows including/excluding original data as
attachment by enabling/disabling the corresponding checkbox.
2. When the Ignore Attachments checkbox is checked, all the attachments are being excluded
from the message which will enhance the collector performance. Each message will contain
only information and the link of the excluded attachment.
3. For more information on how to configure attachments, see Attachments Configuration.
Timestamp Formatting
For more information, on how to configure this section, see Time Stamp Formatting.
Example output message:
198
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
199
Merge1 | User Guide
IMPORTERS
Activities Captured
• Chat messages (created, deleted, edited (the latest version))
• Channel messages (created, deleted, edited (the latest version)) 1
• Chat/channel info
• Voice messages
• Mentions
• Attachments
• Modern attachments
• Reactions2
• Video clips
Important Notes
Due to the changes in the history tracking mechanism, it is required to set the date value for ‘Do not
download data modified after’ to the previous day of the upgrade and run the collector on the new
version only once.
For daily import processes, it is required to clone the collector after the upgrade and on the cloned
collector, set the date value for ‘Do not download data modified before’ to the day of the upgrade.
Ignoring this recommendation can possibly cause duplicates during the first processing after the
upgrade.
Notes
Due to the Microsoft API issues, we have the following limitations3:
1. Messages of deleted teams/channels are not captured.
2. Messages of deleted chats (in case all the chat participants deleted the chat) are not
captured. It is recommended to have the Delete chat feature disabled.
3. Hosted contents from external users are not captured.
1 To capture data from shared channels, the team owner should be included in the monitored users list.
2
Reactions of already captured messages are not captured.
3 The first three cases have been reported to Microsoft and may be resolved at a later time.
200
Merge1 | User Guide
IMPORTERS
4. Deleted messages are available for capture only 21 days from the time of deletion.
5. Hosted contents (including voice messages) of deleted messages are not captured.
201
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Find and make a note your Application (client) ID and Directory(tenant) ID as this is needed
for configuring the collector in Merge1.
6. In the navigation pane to the left, go to Certificates & secrets.
202
Merge1 | User Guide
IMPORTERS
8. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
2. Click Microsoft Graph, and in the opened pane select Application permissions.
203
Merge1 | User Guide
IMPORTERS
• ChannelMember: ChannelMember.Read.All
• ChannelMessage: ChannelMessage.Read.All
• Chat: Chat.Read.All
• Chat: Chat.ReadBasic.All
• ChatMember: ChatMember.Read.All
• ChatMessage: ChatMessage.Read.All
• Files: Files.Read.All
• Group: Group.Read.All
• Team: Team.ReadBasic.All
• User: User.Read.All
4. Once you have selected all the checkboxes, click Add permissions.
204
Merge1 | User Guide
IMPORTERS
5. Get back to API permissions section, click + Add a permission, select SharePoint and then
Application permissions. These are the permissions you need to grant:
• Sites: Sites.Read.All
• User: User.Read.All
6. Once you have selected all the checkboxes, click Add permissions.
7. Once you have selected all the checkboxes, click Grant Admin Consent.
After creating the application in Azure Portal request access to protected APIs. For more information
about Protected APIs in Microsoft Teams click https://aka.ms/teamsgraph/protectedAPIs.
205
Merge1 | User Guide
IMPORTERS
Notes
Creating a subscription in Microsoft Graph requires one of the following licenses:
• Microsoft 365 E5/A5/G5
• Microsoft 365 E5/A5/G5 Compliance
• Microsoft 365 E5/A5/G5/F5 Security
• Microsoft 365 E5/A5/G5 Information Protection and Governance
In case of detecting a user with an improper licensing or other payment issues, the Microsoft Teams
API call fails to fetch the data. Hence, conversations will be captured when at least one of the
participants has the proper Microsoft 365 licensing and has no payment issues. For additional
information about Teams API Pricing and licensing models, see Licensing and payment requirements -
Microsoft Graph | Microsoft Docs.
Applications without an active Azure subscription will get error “HTTP 402 Payment required” when
trying to access the metered APIs using model=A. Applications using Evaluation Mode will also get
error “HTTP 402 Payment required” when the seeded capacity limit is exceeded.
206
Merge1 | User Guide
IMPORTERS
To avoid service disruptions to your application(s), take the following actions if you have not done so
yet:
1. Set up an Azure billing subscription for each application.
2. Set up a payment model (model=A) for each API request of a metered API.
3. If your app is using model=A, ensure that your users have the proper E5 licenses and that DLP
is enabled.
Please note that even if you have previously provided a subscription ID in the Protected API form, for
the subscription to be properly configured, you still need to follow the instructions above to finish the
setup.
Collector Configuration
After filling in the Name and Description on the Add Importer window and selecting the Source on
Configuration Wizard:
1. Add Directory (tenant) Id and Application Id.
2. Provide X.509 Certificate Thumbprint in case you activate the Local machine radio button as
the X.509 Certificate source.
In case you activate Upload file (*.pfx), click the Select button to upload the certificate and
then provide X.509 Certificate Password.
207
Merge1 | User Guide
IMPORTERS
Model Selection
Here the user can make a Model Selection which allows selecting licensing and payment options for
Microsoft Teams APIs:
• Evaluation mode – enables access to APIs with limited usage per requesting an application
for evaluation purposes.
• A – is restricted to applications performing a security or compliance function and requires a
supported license.
208
Merge1 | User Guide
IMPORTERS
2. Enable Certain areas in case either Chats or Channels1 data needs to be collected.
Note that for chats we have the same output message with both Contextual collection of
channels enabled and disabled as this feature relates only to channels.
• If Per room is enabled and Contextual collection of channels is disabled, messages that were
created before the last capture date and edited/deleted after that, are captured separately,
i.e., the already captured messages in the post are not included in the output message.
• If both Per room and Contextual collection of channels are enabled, messages that were
created before the last capture date and edited/deleted after that are captured with their
post messages in the same output message.
• With the Use formatting radio button, the message in the output will be shown formatted.
• With Use light grid formatting, the message will be shown in a light grid mode.
• If Keep only body is activated, the messages will be shown without any formatting.
1 The shared channels' membership type is printed in the output message as "UnknownFutureValue" due to API limitation.
209
Merge1 | User Guide
IMPORTERS
Note that when font-family Segoe UI is present in the output message (HTML tags), and Heading
1,2,3, etc., Bold, and Italic formatting styles are applied, the Segoe UI font is not respected by
Outlook. However, it is respected in HTML online editor.
Also, when Monospaced formatting style is applied, the HTML editor does not respect the given font-
family, and so does the Outlook.
Timestamp Formatting
For more information, on how to configure this section, see Time Stamp Formatting.
Note
The message tracking (and cut-off date filtering) itself is being done by LastModifiedTime or
OriginalDateTime property (determined by the "Import Based On" setting of the collector ) of the
message, as it is the most accurate way to ensure that no data (including edits) is missing, however,
the timestamp that is being printed in the headers of the message is the message creation timestamp
that we are retrieving from the ConversationXML (which becomes available only after filtering, thus, it
cannot be used before the message is retrieved).That timestamp is communicated by the source
vendor (Microsoft) as the only accurate timestamp.
210
Merge1 | User Guide
IMPORTERS
Attachments Configuration
1. The Include original data as attachment feature allows including/excluding original data as
attachment by enabling/disabling the corresponding checkbox.
2. The Ignore Attachments checkbox is checked, all the attachments are being excluded from
the message which will enhance the collector performance. Each message will contain only
information and the link of the excluded attachment.1
3. For Captured Modern Attachments, by selecting:
• Latest version - the latest saved version of shared document available at collector
runtime will be captured with the message.
• Shared version - the saved version of the document at the time of sharing in
Microsoft Teams will be captured with the message.
Splitting Messages
This option allows splitting large files. In the field the size of a split part of the message can be
specified so that each part does not exceed the set size. For example, if the Max Size for each part of
split message is set to 25MB, and the original message is 65 MB, it will be split into 3 messages, each
not exceeding 25MB.
Sample output:
1
In case 'Ignore attachments' is checked and user generates a message in a chat with attachments and then replies to it, the
parent message will not be rendered to the reply in the output message.
211
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
212
Merge1 | User Guide
IMPORTERS
Activities Captured
• Chat messages (created, edited (previous versions), deleted (the latest version))
• Channel messages (created, edited (previous versions), deleted (the latest version))
Warning
For users that need to use the Merge1 Microsoft Teams via Webhooks importer for reactive
(targeted) discovery:
• Items are available for reactive discovery in the Webhooks portal according to the retention
period set when configuring the subscription in the Working in the Globanet Portal.
• The maximum amount of time is 90 days.
• When running a targeted discovery search, please allow an end-date greater than the
message date to accommodate for latency in delivery of items to the portal by Microsoft.
Even though Webhooks technology is usually instantaneous, Microsoft Support has confirmed
that there are sometimes delays in data processing which affects their webhooks delivery.
Allowing for a larger period for cut-off, ensures that data is not missed during discovery.
213
Merge1 | User Guide
IMPORTERS
214
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Find and make a note your Application (client) ID and Directory(tenant) ID as this is needed
for configuring the collector in Merge1.
6. In the navigation pane to the left, go to Certificates & secrets.
215
Merge1 | User Guide
IMPORTERS
8. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
216
Merge1 | User Guide
IMPORTERS
217
Merge1 | User Guide
IMPORTERS
The permission User.Read can be removed as this is added by Azure by default and is not
required for Merge1.
Please make sure that the consent has been successfully granted.
8. Click SharePoint.
218
Merge1 | User Guide
IMPORTERS
219
Merge1 | User Guide
IMPORTERS
220
Merge1 | User Guide
IMPORTERS
Note that this public key will be sent to Microsoft Graph during subscription creation and the key will
be used to encrypt the data before it is sent to Veritas cloud infrastructure, i.e., only Private Key
holders will be able to decrypt the notifications sent by Microsoft Graph. Veritas does not have access
to the private key.
221
Merge1 | User Guide
IMPORTERS
• You can self-sign the certificate, since Microsoft Graph does not verify the certificate
issuer, and uses the public key for only encryption
• The key must be of type RSA
• The key size must be between 2048 and 4096 bits.
2. Export the certificate in base64-encoded X.509 format and upload it to the Veritas Webhooks
site during subscription creation.
3. Export the private key and install it on the Merge1 server that will be used to capture data
gathered by the Webhooks Platform.
Note
Creating a Webhooks subscription in Microsoft Graph, requires one of the following licenses:
• Microsoft 365 E5/A5/G5
• Microsoft 365 E5/A5/G5 Compliance
• Microsoft 365 E5/A5/G5/F5 Security
• Microsoft 365 E5/A5/G5 Information Protection and Governance
All participants in the conversation should have the required Microsoft 365 licenses to ensure
complete data collection. For additional information about Teams API Pricing and licensing models,
see Licensing and payment requirements - Microsoft Graph | Microsoft Docs.
Applications without an active Azure subscription will get error “HTTP 402 Payment required” when
trying to access the metered APIs using model=A. Applications using Evaluation Mode will also get
error “HTTP 402 Payment required” when the seeded capacity limit is exceeded.
To avoid service disruptions to your application(s), take the following actions if you have not done so
yet:
1. Set up an Azure billing subscription for each application.
2. Set up a payment model (model=A) for each API request of a metered API.
3. If your app is using model=A, ensure that your users have the proper E5 licenses and that DLP
is enabled.
Please note that even if you have previously provided a subscription ID in the Protected API form, for
the subscription to be properly configured, you still need to follow the instructions above to finish the
setup.
222
Merge1 | User Guide
IMPORTERS
Collector Configuration
After filling in the Name and Description on the Add Importer window and selecting the Source on
Configuration Wizard:
1. Enter the Client ID and Client Secret (See Working in the Globanet Portal), in the
Application ID and the Secret fields correspondingly and click NEXT.
2. Enter the Subscription ID (See Working in the Globanet Portal), MS Azure Application ID,
and MS Azure Directory ID in the Authentication section.
3. Provide X.509 Certificate Thumbprint in case you activate the Local machine radio button
as the X.509 Certificate source.
223
Merge1 | User Guide
IMPORTERS
224
Merge1 | User Guide
IMPORTERS
• Options Do not download data modified before and Do not download data modified after
allow cutting off data outside the set date range. If the before date is set to 08/17/2022 and
the after date is set to 08/25/2022, only the data between these two dates will be
downloaded. Data outside that timeframe will be ignored. Note that both options can be
used independently as well.
Attachments Configuration
For more information on how to configure attachments, see Attachments Configuration.
Note that in case of using file filtering by size and by type we recommend using custom messages.
Message Body
This specifies how the imported message will be displayed in the target. The Basic HTML mode
organizes the data in a simple way and data displayed in a Light Grid Mode is two-toned, easy to be
viewed with limited metadata.
Output sample:
225
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
226
Merge1 | User Guide
IMPORTERS
OneDrive metadata is used to create Merge1 email file. The metadata includes document creator
(author in the Merge1 email file), the file name (subject), Modified date (sent date), item id, name,
CreatedBy, CreatedDateTime, LastModifiedBy, LastModifiedDateTime, webUrl, size, parentReference,
folderId and any other tags listed in the message body are added to the email file body.
Activities Captured
• Uploaded files
• Renamed files
• ‘Delete’ event without the file1 2
• New created documents via browser with the file
Notes
• Microsoft OneNote files (where users' notes, drawings, screen clippings, and audio
commentaries are gathered) are captured.
• Only the latest activity is captured in case there are performed more than one activity in the
same file.
1 Delete events are not captured during the first run and immediately after the deletion.
2
Hard deleted items, i.e., items that have been deleted from Recycle bin as well, are not captured.
227
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Enter the enter the URL of your local Merge1 environment in the following format:
https://<your_merge1_domain>/Configuration/OAuthCallback. Click
Register.
228
Merge1 | User Guide
IMPORTERS
6. Find and make a note your Application (client) ID and Directory(tenant) ID as this is needed
for configuring the collector in Merge1.
7. In the navigation pane to the left, go to Certificates & secrets.
229
Merge1 | User Guide
IMPORTERS
9. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
2. Click Microsoft Graph, and in the opened pane, select Application permissions.
230
Merge1 | User Guide
IMPORTERS
• Files: Files.Read.All
• Directory: Directory.Read.All
• User: User.Read.All
• Applications: Applications.Read.All
• Applications: Applications.ReadWrite.All1
5. Get back to API permissions section, click + Add a permission and select SharePoint API with
Application permissions. These are the permissions you need to grant:
• Sites: Sites.Read.All
• User: User.Read.All
• TermStore: TermStore.Read.All
Once you have selected all three checkboxes, click Add permissions.
1 Only required if the certificate has not been already uploaded to the Azure App.
231
Merge1 | User Guide
IMPORTERS
Collector Configuration
After filling in the Name and Description on the Add Importer window and selecting the source on
Configuration Wizard:
3. In case you activate Upload file (*.pfx), click the Select button to upload the certificate and
then provide X.509 Certificate Password.
4. You can copy the Application ID from the Azure Active Directory > App Registrations > <your
app name> section.
232
Merge1 | User Guide
IMPORTERS
Attachments Configuration
1. The Include original data as attachment feature allows including/excluding original data as
attachment by enabling/disabling the corresponding checkbox.
2. When the Ignore Attachments checkbox is checked, all the attachments are being excluded
from the message which will enhance the collector performance. Each message will contain
only information and the link of the excluded attachment.
3. For more information on how to configure attachments, see Attachments Configuration.
Timestamp Formatting
For more information, on how to configure this section, see Time Stamp Formatting.
233
Merge1 | User Guide
IMPORTERS
2. Options Do not download data modified before and Do not download data modified after
allow cutting off data outside the set date range. If the before date is set to 08/17/2022 and
the after date is set to 08/25/2022, only the data between these two dates will be
downloaded. Data outside that timeframe will be ignored. Note that both options can be
used independently as well.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
234
Merge1 | User Guide
IMPORTERS
PIVOT
Pivot is an instant messaging platform that allows collaboration with financial market participants
over its secure and fast network.
Activities Captured
• Participant entered:
o Date time
o Internal flag
o Corporate email ID
• Message:
o Date time
o Content
• Participant left:
o Date time
o Corporate email ID
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
235
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
236
Merge1 | User Guide
IMPORTERS
REDTAIL SPEAK
Redtail is a CRM system that focuses on financial advisor/client relationships. The Speak feature is an
add-on model that allows advisors to communicate with their clients, team members, and the
company overall. Through its Speak platform, Redtail can send text messages to communicate with
the clients and recognizes the need for compliance.
Merge1 collects Redtail Speak messages from the Redtail Speak SMTP server. For setting up an SMTP
server, contact Veritas Support | Veritas™.
Activities Captured
• One-on-one chats with team members
• Public/private group conversations
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• SSH Key Authentication
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
237
Merge1 | User Guide
IMPORTERS
REFINITIV
Refinitiv brings a user the latest news from around the world, covering breaking news in markets, the
business, politics, entertainment, technology, video. Merge1 Refinitiv collector processes data from
Eikon Messenger and SI Dealing.
Eikon Messenger is captured and delivered to clients either via a daily XML posted to FTP (External
Feed) or hosted archiving (Global Relay). The Eikon Messenger instant messaging network is based on
an individual’s user ID + firm name and is captured/recognized as such.
Contact Veritas Technologies Support for more details on the mapping corresponding to the source,
you are going to use for Refinitiv collector.
Activities Captured
• Person to person messages
• Group chats
• Attachments
• Disclaimers
Notes
• To process current schema files, the file filter should be configured with the following
extensions: messages\.zip, attachments\.zip,(^.+?)\.csv.
• Quarantine sources column on the Dashboard shows the number of the files moved to the
quarantine folder while processing source files with the below listed configured formats. All
other files have initially been considered unwanted files and have been moved to the
quarantine folder.
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• PGP Configurations
• Attachment Validation
• Folder Configurations
• Miscellaneous Settings
Refinitiv Options
The option Split by Day merges the messages from the same day into one email message. The time
zone by which the messages are split can be selected from the drop-down menu. This option can be
selected only if Merge Messages by Thread is selected.
238
Merge1 | User Guide
IMPORTERS
Message Body
In the Refinitiv collector you can choose between three IB message body options, which specify how
the imported message will be displayed in the target.
When you select the Plain Mode option, you will see the interactions below each other.
If you enable the Grid Mode option, you will see the information in the five following columns:
• UTC Time Stamp, which includes the date of the sent message
• Content
• Event Type, what kind of an event the activity is (joining the chat, sending a message, etc.)
• Message ID
• Attachment.
It is possible to change the color scheme of the grid mode by clicking the Select Style link.
When you select the Light Grid Mode, the data is two-toned, easy to be viewed with limited
metadata.
Plain Mode:
239
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
240
Merge1 | User Guide
IMPORTERS
RINGCENTRAL
RingCentral Team Messaging is a team collaboration solution that helps organize and centralize team
communication. RingCentral provides a compliance API that will be used to download messages and
meeting-based content.
Activities Captured
• Chats
• Tasks
• Notes
• Events
Compliance Exports
Compliance Exports is a special capability specifically built for companies and regulated industries,
such as financial services, with compliance requirements for using electronic communication in the
workplace. This feature is also a fail-safe way of preserving business communications for legal
discovery or internal review.
https://developers.ringcentral.com/guide/team-messaging/manual/compliance-export-structure
When you download a compliance export, you will receive a .zip file that contains a number of files
and folders that contain all of the data associated with your data export.
Note
Only the content and items that fall within the specified period for the archive are included in the
downloaded/compliance export file. Therefore, data outside that time range is not captured.
241
Merge1 | User Guide
IMPORTERS
2. You will be navigated to the Apps console were all your apps are listed and can be managed.
Click Create App at the upper right corner of All applications.
Note that if you see the Create App button, but it is disabled, then your account lacks the
permission required to create an app. Contact your account administrator to request this
permission.
3. Select your app type and click Next.
242
Merge1 | User Guide
IMPORTERS
5. Select No for Do you intend to promote this app in the RingCentral App Gallery? (for internal-
use only)
6. In the Auth section, make sure 3-legged OAuth flow authorization code is enabled and select
Server-side web app (most common).
7. In the OAuth Redirect URI field, enter the URL of your local Merge1 environment in the OAuth
Redirect URI field with the following format:
https://<merge1_instance>/Configuration/OAuthCallback 1.
8. In the Security section, select Read Accounts and Team Messaging from the App Permissions
drop-down list. Click Create.
In the opened window, you will find your application details, including Client ID, Client Secret, and
RingCentral Server URL.
1
You can find it in the 5th point of the click information.
243
Merge1 | User Guide
IMPORTERS
Collector Configuration
To set up the collector:
1. Click Add Importer, specify Name and a Description(optional), and select the collector from
the list. The RingCentral Application Configuration window will open.
2. In the Application ID field enter Client ID copied previously, in Application secret/key, enter
the copied Client Secret, enter the API server URL in the RingCentral server URL field, and
then click Next.
244
Merge1 | User Guide
IMPORTERS
Attachments Configuration
For more information on how to configure attachments, see Attachments Configuration.
Note when the Ignore Attachments checkbox is checked, all the attachments are being excluded from
the message which will enhance the collector performance. Each message will contain only
information and the link of the excluded attachment.
Note that in case of using file filtering by size and by type, we recommend using custom messages.
Sample message:
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
245
Merge1 | User Guide
IMPORTERS
SERVICENOW
ServiceNow is a customizable service management platform that facilitates requests for support items
such as hardware, software requests. The platform has ability for partners to develop solutions and
add to the ServiceNow app library.
Activities Captured
• Live messages with comments and attachments created in My Feed
• Live messages with comments and attachments created in Company Feed
• Live messages with comments and attachments created in Group feed (Public/Private)
• Conversations with comments and attachments (one-on-one, group)
• Deletes
• Polls with choices and votes
• Like counts
• Links
• Mentions
• Emojis
Note that when the group is deleted, the messages are not captured.
246
Merge1 | User Guide
IMPORTERS
2. Click the Application Registry and the applications list will open. Click New.
3. Select the Create an OAuth API endpoint for external clients option.
6. After executing the provided steps, on the Application Registry page you will find the
application you have just created. Click your application, and in the opened window, you will
find your application details, including Client ID and Client Secret.
247
Merge1 | User Guide
IMPORTERS
7. Copy and save the Client ID and Secret to later provide them to Merge1 as part of ServiceNow
configuration.
Collector Configuration
To set up the collector:
1. Click Add Importer, specify Name and a Description (optional), and select the collector from
the list. The ServiceNow Application Configuration window will open.
2. Add your ServiceNow Instance URL, the App Key copied previously in the Application ID field,
and in Application Secret/Key, enter copied Secret, and then click NEXT.
Timestamp Formatting
In addition to the primary stamp, a second timestamp can be enabled with its time zone. From the
drop-down list you can choose the time zone of the timestamp. The format of the timestamp in the
output message can also be specified from the six options in the Date time format drop-down list. You
should also select ServiceNow API Time zone which shows system default time zone on ServiceNow
instance1.
248
Merge1 | User Guide
IMPORTERS
Note that if selected time zone is not matching with your ServiceNow instance default time zone
there might be some unwanted consequences.
Attachment Configuration
For more information on how to configure attachments, see Attachments Configuration.
Message Body
This specifies how the imported message will be displayed in the target. The Basic HTML mode
organizes the data in a simple way and data displayed in a Light Grid Mode is two-toned, easy to be
viewed with limited metadata.
Note that in case of using file filtering by size and by type we recommend using custom messages.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
249
Merge1 | User Guide
IMPORTERS
SHAREPOINT
SharePoint is a web-based collaborative platform that integrates with Microsoft Office. Launched in
2001, SharePoint is primarily sold as a document management and storage system, but the product is
highly configurable, and the usage varies substantially among organizations.
Activities Captured
• Newsfeed/Document library/ Picture library posts
• Newsfeed /Document library/ Picture library comments
• Custom lists items
• Custom lists comments
• Site page comments
Note
The SharePoint CSOM API provides two identical versions of the same data with a different version
numbering and for the storage and visibility sack, only one version is kept.
250
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Enter the enter the URL of your local Merge1 environment in the following format:
https://<your_merge1_domain>/Configuration/OAuthCallback. Click
Register.
251
Merge1 | User Guide
IMPORTERS
6. Find and make a note your Application (client) ID and Directory(tenant) ID as this is needed
for configuring the collector in Merge1.
7. In the navigation pane to the left, go to Certificates & secrets.
252
Merge1 | User Guide
IMPORTERS
9. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
253
Merge1 | User Guide
IMPORTERS
4. Once you have selected all three checkboxes, click Update permissions.
5. Get back to API permissions section, click + Add a permission and select SharePoint API with
Application permissions (Figure 409). These are the permissions you need to grant:
• Sites: Sites.FullControl.All; Sites.Read.All
1 Only required if the certificate has not been already uploaded to the Azure App.
254
Merge1 | User Guide
IMPORTERS
• User: User.Read.All
• TermStore: TermStore.Read.All
Once you have selected all three checkboxes, click Add Permissions.
Collector Configuration
To set up the collector:
1. After you click Add Importer, and specify Name and a Description(optional), in the opened
window you need to provide Application ID, and Application Secret/Key.
You can copy the Application ID from the Azure Active Directory > App Registrations > <your
app name> section.
255
Merge1 | User Guide
IMPORTERS
4. In case you activate Upload file (*.pfx), click the Select button to upload the certificate and
then provide X.509 Certificate Password.
5. After clicking Next, a pop-up window should appear where you should provide the O365
Global Admin user credentials (please note that usually the pop-up is being blocked by the
browser so pay attention to the top right corner of the browser if the popup is not
appearing). In the next window, click Accept to grant the permissions.
256
Merge1 | User Guide
IMPORTERS
SharePoint Activities
For SharePoint activities:
1. Activate Monitor all sites in case all SharePoint sites should be monitored. In this case, file
upload and download options will be inactive.
2. Activate Monitor certain sites in case only certain SharePoint sites/sub-sites should be
monitored.
3. Upload the CSV file that includes:
• The site/sub-site URL which can be found by clicking the Copy button from the right-
side opened Page Details window.
• TRUE or FALSE options which will specify whether the sub-sites should or should not
be monitored accordingly. If not specified, the default value will be FALSE, i.e., sub-
sites will not be monitored.
4. In case you need to make changes in the CSV, download the already uploaded file, make the
necessary changes, and upload it again.
257
Merge1 | User Guide
IMPORTERS
• Microfeed
• Site page
• Document library
• Picture library
• Custom list
If the file names contain the “#” and “%” symbols, they will not be downloaded.
Timestamp Formatting
For more information on how to configure this section, see Time Stamp Formatting.
• The Single message per event captures each event (post, comment, reply) in one message.
• The Single message per comment and its replies/sub-comments captures a message and all
replies and comments related to it in one output message.
• The Single message per site captures all messages and their replies and comments in one
combined message.
If any event has been changed after single Merge1 run, when it is run the next time, the updated
version of the event will be imported. The processing modes apply both to the Newsfeed and to the
Site Page comments.
Attachment Configuration
1. When the Ignore Attachments checkbox is checked, all the attachments are being excluded
from the message enhancing the collector performance. Each message will contain only
information and the link of the excluded attachment.
2. For more information on how to configure attachments, see Attachments Configuration.
Note that in case of using file filtering by size and by type, we recommend using custom messages.
Example of output message:
258
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
259
Merge1 | User Guide
IMPORTERS
Merge1 captures OCS/Lync/Skype for Business chats from SQL databases. Attachments are not
captured, so they should be disabled for the compliance.
To capture messages from persistent chat rooms, Enable Chat History option should be selected from
Persistent Chat category section.
Activities Captured
• Messages between users
• Persistent chats
• Message deletes not allowed by the system
• Message edits not allowed by the system
DB Configuration
Merge1 retrieves data from Lync/Skype for Business directly from its database(s).
Select the Source System Type from the drop-down list. (Merge1 supports Lync/Skype for Business
versions 2007 through 2013) Persistent Chat and Compliance databases are configurable for version
2013 only.
Note
Your Merge1 service account must have read access to your Skype for Business Compliance
Databases (the default database names for Skype for Business are: LCSlogs, mgc, mgccomp).
260
Merge1 | User Guide
IMPORTERS
In the Merge1 Configuration for Skype for Business, we have three types of databases: Archive,
Persistent Chat, and Compliance, which are configured individually by providing database server
addresses and authentication credentials.
To change the configurations of individual database types, click Configure next to the Archive
Database.
261
Merge1 | User Guide
IMPORTERS
to provide a consistent copy of data across all the database nodes. It also removes
any data redundancy, merging of two databases into one and updating the secondary
databases with outdated or incomplete data.
Other Options
For other options:
• The Subject Prefix is added to the subject line of imported emails. This is useful for organizing
imported data, i.e., when multiple sources share a common target.
• When Single Message per Conversation is selected, a single message is archived for each
conversation.
• When Single Message per Conversation Contributor is selected, a single message is archived
for each conversation with one version of the conversation per participant. This allows for the
data to be searched for based on the participant’s name. You can enable Bloomberg Vault
Format to enable Bloomberg archive formatting.
• If Single Message per IM is enabled, each IM in the conversation is imported as a separate
message.
• If Single Message per User (Combine all conversations) is enabled, a separate archive is
created for each User and includes all conversation of that participant. The From field will
contain the user's email address, the To field will contain all the email addresses of those with
whom that user has chatted, and the Body will contain all the user's conversations.
• Options Do not download data modified before and Do not download data modified after
allow cutting off data outside the set date range. If the before date is set to 08/17/2022 and
the after date is set to 08/25/2022, only the data between these two dates will be
downloaded. Data outside that timeframe will be ignored. Note that both options can be
used independently as well.
• Enable Message Chunking if you want to break down the data segments into chunks
containing the specified number of messages.
262
Merge1 | User Guide
IMPORTERS
• If you want to exclude messages that were sent within the past X number of hours, you can
enable Archiving Delay Check.
• For persistent chats use _ as user identifier option allows specifying the values from which
columns of the source DB should be assigned to the monitored users. The options are:
prinUri, prinEmail, prinADUserPrincipalName.
• Enabling Bloomberg Vault Format checkbox output message will be as shown.
263
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
264
Merge1 | User Guide
IMPORTERS
SLACK eDISCOVERY
The Slack eDiscovery collector allows retrieving data from Slack Enterprise account workspaces,
consolidate it into one archive or mail for eDiscovery. Enterprise Grid is a "network" of two or more
Slack workspace instances. Each Slack workspace has its team ID, its directory of members, its
channels, conversations, files, and zeitgeist.
To set up the Slack eDiscovery collector, open the C:\Program Files\Globanet Consulting Services\Merge1
7.0\UserSettings.config folder1 and replace the last four lines with the following:
In addition, you should contact Slack at [email protected] and ask to enable Discovery API for your
organization before finishing the collector set up.
You should use https://localhost to access Merge1 portal for passing the OAuth for eDiscovery.
Note that after setting up you can change it back to your IP address.
Activities Captured
• Activities from all workspaces
• Direct messages
• Multi participant direct messages
• Channel conversations/messages
• Attachments (the attachment itself is included in the message generated by Merge1 as an
attachment)
• Attachments shared using third-party integrations such as OneDrive (only the link is included
in the body of the message generated by Merge1)
• Emojis (as texts)
• Deletes (including the deleted message and the event itself)
• Edits (including the message before and after it is edited)
• Guest conversations
• Message reactions2
• Shared channel events (channels shared with external organizations3)
• Channel join event
• Set channel purpose event
1 For Merge1 version 6.0, the path will be C:\Program Files\Globanet Consulting Services\Merge1
6.0\UserSettings.config.
2 Reactions for deleted messages are not captured.
3 Including the external users’ names.
265
Merge1 | User Guide
IMPORTERS
Note that capturing the edit and delete activities depend on the retention policy of your Slack
Enterprise account. You can set message retention to "Keep all messages and keep edit and deletion
logs" from https://my.slack.com/admin/settings#data_retention. This will work for public channels. If
you need to capture all edit and deletion logs for private channels and direct messages as well, please
check the Retention Policy of your Slack Enterprise account.
Collector Configuration
To set up the Slack eDiscovery collector:
1. Log into your Slack Enterprise workspace using the organization URL. You should stay logged
into your account when adding a Merge1 collector.
266
Merge1 | User Guide
IMPORTERS
267
Merge1 | User Guide
IMPORTERS
268
Merge1 | User Guide
IMPORTERS
Message Body
This specifies how the imported message will be displayed in the target. The Plain Text mode
organizes the data in a simple way and data displayed in a Light Grid Mode is two-toned, easy to be
viewed with limited metadata.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
269
Merge1 | User Guide
IMPORTERS
SYMPHONY
Symphony provides secure enterprise collaboration. Users can communicate with internal and
external teams, securely share documents and content, conduct meetings with conferencing and
screen-sharing, leverage open APIs in the growing app ecosystem to streamline and automate
workflows.
The Symphony collector works with XML format only. Make sure that the files are in the correct
format. There are following mappings of XML tags to emails:
• <initiator> = From
• <sentTo> = To
• <readBy> = CC
Note that the Symphony collector can process only unzipped XML files.
Activities Captured
• Post date
• From
• Message content
• Record type
• Message ID
• Attachment
• Downloaded by
• Event action
• Read by
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• SSH Key Authentication
• PGP Configurations
• Folder Configurations
Miscellaneous Settings
The Subject prefix is added to the subject line of imported emails. This is useful for organizing
imported data especially when multiple sources share a common target.
270
Merge1 | User Guide
IMPORTERS
Attachment Validation
Merge1 enables you to develop customized notes for attachment validation. The default setting is
Fail Messages with missing Attachments, so the messages that do not have attachments are failed
and can be viewed under the Reports.
If you select the Replace all the attachments with the following note and input your custom note, all
the attachments to the messages will not be processed and in their place under the Reports you will
see only the custom message that you have entered.
If you select the Replace missing attachments with the following note and input your custom note, all
the missing attachments of the messages will not be processed, and you will see only the custom
message that you have entered (Figure 430).
• Merge Messages by Thread - when selected, messages with identical thread IDs are grouped
into individual emails (as opposed to receiving a separate email per message). It is possible to
select additional fields (Downloaded By and Read By) to be added to the merged message.
• Use the timestamp of the first record as message timestamp - selected only when Merge
Messages by Thread is selected. When enabled, it uses the timestamp of the first Symphony
message as a message timestamp, instead of the one of the last messages.
• Grid Mode - activated only when Merge Messages by Thread is selected. It allows viewing the
email content in a compact grid format. When Grid Mode is selected additional checkboxes
will appear that can activate extra columns in the gridded message. The Grid mode color
scheme can also be customized by clicking Select Style.
Note that limited information will be included in the output message:
271
Merge1 | User Guide
IMPORTERS
o Postdate
o From
o MessageContent
o RecordType
o MessageID
o Attachment
o DownloadedBy
o EventAction
o ReadBy
• When Process messages with ‘’IsArchived’’ tag is checked, messages that have the IsArchived
tag are processed as well.
• When Ignore readby messages is checked, messages with ReadBy field in them will be
ignored.
Split Message
Splitting Messages option allows splitting big files. In the field the size of a split part of the message
can be specified so that each part does not exceed the set size (Figure 431). For example, if the Max
Size for each part of split message is set to 25MB, and the original message is 65 MB, it will be split
into 3 messages, each not exceeding 25MB.
In case you have a limitation of 25 MB on your server, you must split your message max to 17MB as
the server also must have space for some encryption and decryption tasks that are being carried out
by Merge1.
• Social Message
• Event
• Email Notification.
272
Merge1 | User Guide
IMPORTERS
Example of a part of the message from email when Merge Messages by Thread is selected. On the
right the message is shown when additional options to show DownloadedBy and ReadBy are selected.
Example of an email with Grid Mode enabled with additional options checked (DownloadedBy,
ReadBy, Attachment, Event Action).
273
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
274
Merge1 | User Guide
IMPORTERS
TEXT-DELIMITED
Merge1 Text- Delimited is designed to allow rapidly developing text- delimited file processing. The
objective of the collector is to map the text- delimited fields to email required format. The mapping is
done based on the uploaded XML template. It varies from source to source; it must be written
separately. For more details on the mapping, corresponding to the source, you are going to use it for,
contact our support at https://www.veritas.com/support.
Activities Captured
• Participants: From, To, CC, and BCC
• Start time
• End time
• Body message
• Custom mappings
• Attachments
Notes
• To process the attachments, add the full path to the attachment in the CSV document. To
prevent files with similar names, we recommend creating attachments with folder structure
to avoid clash of files with similar names shared on different days and in different
conversations.
• To process the files properly, the files, that are going to be processed, and attachments
should have the same name.
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
275
Merge1 | User Guide
IMPORTERS
The XML file should contain the information about the file itself. It should specify if the file contains
headers, the number of columns, delimiter type and the text qualifier. Next part of the XML file
should assign column names, identify data types, and indicate if the columns are optional. Lastly, it
should map the columns to the expected data fields: From/Sender, To, Subject/Title,
Date/ActivityDateTime, and Body/Content (Figure 439; Figure 440).
If you want to manually set up the Source Time Zone, select the relevant one from the drop-down list.
The Source Time zone setting will attempt to retrieve the time zone from the data itself automatically.
Message Body
This specifies how the imported message will be displayed in the target. The Plain Text mode
organizes the data in a simple way and data displayed in a Light Grid Mode is two-toned, easy to be
viewed with limited metadata (Figure 438).
<version>TD_3.0</version>
<options>
<containsHeader>Yes</containsHeader>
1 Note that if you want attachments to be processed properly, they should be in the same zipped folder and have attachments.zip format.
276
Merge1 | User Guide
IMPORTERS
<maxCols>6</maxCols>
<delimiter>","</delimiter>
<text_qualifier>"</text_qualifier>
<attachmentMethod>Archive</attachmentMethod>
<content_type>Html</content_type>
</options>
2. Assign column names, identify data type, and indicate if columns are optional.
<columns>
<column>
<order>1</order>
<name>Date</name>
<datatype>DateTime</datatype>
<datatype_options>
<format>XX/DD/YYYY HH:MM</format>
</datatype_options>
</column>
<column>
<order>2</order>
<name>From Email</name>
<datatype>String</datatype>
</column>
<column>
<order>3</order>
<name>To Email</name>
<datatype>String</datatype>
</column>
<column>
<order>4</order>
<name>Subject</name>
<datatype>String</datatype>
</column>
<column>
<order>5</order>
<name></Body</name>
<datatype>String</datatype>
</column>
<column>
<order>6</order>
<name>FILE_NAME</name>
<datatype>StringList</datatype>
<datatype_options>
<delimiter>";"</delimiter>
</datatype_options>
</column>
</columns>
277
Merge1 | User Guide
IMPORTERS
3. The last part of the XML file maps the columns to the expected data fields: Sender,
Participants, Title, ActivityDateTime, Body and Threading 1:
<mappings>
<mapping can_be_empty = "Yes">
<property>Sender</property>
<items>
<item>From Email</item>
</items>
</mapping>
<mapping can_be_empty = "Yes">
<property>Participants</property>
<items>
<string Role="Cc">"[email protected]"</string>
</items>
</mapping>
<mapping can_be_empty = "Yes">
<property>Title</property>
<items>
<item>Subject</item>
</items>
</mapping>
<mapping can_be_empty = "Yes">
<property>Content</property>
<items>
<item>Body</item>
</items>
</mapping>
<mapping can_be_empty = "Yes">
<property>ActivityDateTime</property>
<items>
<item>Date</item>
</items>
</mapping>
<mapping can_be_empty = "Yes">
<property>Attachments</property>
<items>
<item>FILE_NAME</item>
</items>
</mapping>
<mapping can_be_empty = "Yes">
<property>X-KVS-MessageType</property>
<items>
<string>"Telemessage"</string>
</items>
</mapping>
</mappings>
<threading disabled = "No">
<case_sensitive>No</case_sensitive>
<date_sort_direction>Ascending</date_sort_direction>
278
Merge1 | User Guide
IMPORTERS
<items>
<item>From Email</item>
<item>To Email</item>
</items>
</threading>
</configuration>
Parsed output:
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
279
Merge1 | User Guide
IMPORTERS
TWITTER
Twitter is an online news and social networking site where people communicate in short messages
called tweets. The Twitter collector does not work with a proxy server.
Activities Captured
• GIFs are captured as links
• GIF post texts
• Attachments are captured as links
• Comments
• Retweets
• Quote tweets
• Emojis
• Tweets to timelines
• Poll post note (poll options are not captured)
Collector Configuration
To activate Twitter Importer, fill in the following information in the Configuration Wizard of the
Source tab:
1. Provide your Twitter Application ID.
2. Enter the Application Secret/Key.
3. Click Save.
280
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
281
Merge1 | User Guide
IMPORTERS
UBS
UBS provides financial advice and solutions to private, institutional, and corporate clients worldwide.
Activities Captured
• Datetime
• First name
• Last name
• Company name
• Says
• Content
• Participant’s full name
• Email
• User ID
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
UBS Options
Merge1 enables you to validate the UBS attachments. You can either group all messages based on
participants or you can group messages by date.
You can also set grouping interval. The time is calculated in hours.
282
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
283
Merge1 | User Guide
IMPORTERS
Activities Captured
• Web page in PDF
• Web page in PNG
• Web page in custom formats
Heavy pages with the depth of capture more than 1 may be captured not fully, as all the pages may
not be loaded completely by the time of the capture.
Collector Configuration
To configure URLs:
1. Click +Add Configuration Group.
2. Enter the Group Name for the output files of the captured URL.
3. Select the Output Format. It can be a PDF, PNG, or custom format file. For the custom format,
please contact our support at https://www.veritas.com/support.
4. Enter the website URL from which the capture should start.
5. Choose the capture mode: Full Domain or One Page. One Page captures only the entered
URL. Full Domain captures the mentioned URL and the pages that open from it with the same
domain on the mentioned depth.
6. The depth is the level of the pages on the site map that should be captured. It includes the
main website URL given in the configuration and the site pages below it on the site map. For
Example, if the depth is 1, the Web Capture collector captures the filled in website URL and all
the pages that open from that URL and have the same URL in their URLs.
284
Merge1 | User Guide
IMPORTERS
Message Construction
As the messages generated by the Web Page Capture collector do not have senders or recipients,
from and to email addresses need to be entered manually for the output email files to be generated.
It is recommended to use existing email address in the From Email Address field, to avoid it being sent
to the SPAM folder if the target of the collector is a mailbox.
285
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
286
Merge1 | User Guide
IMPORTERS
Custom Integrations are not available in the free Workplace plans, customers who need to meet
Compliance and eDiscovery must have a Premium plan.
Activities Captured
Chats:
• One-on-one chats
• Group chats
• Attachments in chats
• Deleted messages and attachments in chats (if only one chat participant has deleted the
message)1
• “Add” events in group chats
Posts:
• Group posts (except multi-company groups, and main posts of buy & sell groups)
• Attachments2
• Polls (without attachments)
• GIFs
• Emojis
• GIF posts (mp4 format only)
• Likes & reactions to posts
• Comments and replies (without attachments)
• Photos
• Posts in MD format (without formatting)
• “Create” events (only images)
• Create doc posts in TXT format (without image)
• Live videos
• Latest versions of posts (except attachments)
1 If there is only one participant in the group chat, the deleted message/attachment is not captured.
2 Workplace side internal server error occurs in case of having 80+ attachments.
287
Merge1 | User Guide
IMPORTERS
• Reply to
• Reactions.
Group posts:
• Timeline activities
• Deleted group posts
• Name of the group
• Tagging coworkers
• Check-ins
• Feeling/Activity
• Comments deleted
• Created events
• Hidden chats
• Posts created on someone’s timeline
• Previous versions of posts
Custom Integrations are not available in free Workplace plans, so customers who need to meet
Compliance and eDiscovery must have a Premium plan.
288
Merge1 | User Guide
IMPORTERS
6. Copy App ID and App Secret. Click Create Access Token and copy the generated token.
7. If Discoverable is set to Yes, change it to No (Figure 452). This is not required but it is best
practice to make sure the users are not aware of existence of the application.
289
Merge1 | User Guide
IMPORTERS
9. To make sure the permissions remain available for Merge1, disable Automatically remove
unused permissions. This is not required; you can leave it on for better security, but you
might need to come back to this page and re-add the permissions.
Note that Facebook allows you to scope the App's permissions to specific groups.
This is recommended if you only need to monitor users of the certain groups.
10. Following best security practices, enable Require App Secret Proof and allow list the public IP
addresses of your Merge1 server(s), gateways and/or proxy server(s).
290
Merge1 | User Guide
IMPORTERS
Collector Configuration
To configure the collector:
1. Enter the App ID copied in the Step 6 of the previous section in the Application ID field, the
App Secret in the Application Secret/Key field, and the Access Token in the Access Token field
(Figure 456).
Attachment Configuration
For more information on how to configure attachments, see Attachments Configuration.
291
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
292
Merge1 | User Guide
IMPORTERS
XIP
Greenwich Associates is the leading global provider of market intelligence and advisory services to the
financial services industry. They specialize in providing fact-based insights and practical
recommendations to improve business results.
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
Once you have selected the Collector Type, you can also provide the Source Time Zone information.
Merge1 assumes that the messages in the source file are of the set time zone and based on that data
the dates in the messages are processed to UTC time zone. By default, Merge1 sets the Source Time
Zone as the Local Time Zone.
293
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
294
Merge1 | User Guide
IMPORTERS
XSLT/XML
Merge1 XSLT/XML collector allows our customers to rapidly transform XML file using XSLT to a
predefined format. Once XML is transformed, Merge1 can process the XML by generating the
required mapping "From" "To" "Subject" "Date" "body" fields to appropriate elements of the XML file.
The mapping varies from source to source, and it must be written separately. Contact Veritas
Technologies LLC Support for more details on the mapping corresponding to the source you are going
to use it for.
Activities Captured
• Participants: From, To, CC, and BCC
• Start time
• End time
• Body message
• Device used
• Attachments
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• SSH Key Authentication
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
295
Merge1 | User Guide
IMPORTERS
296
Merge1 | User Guide
IMPORTERS
YAMMER
Yammer is a collaboration tool that helps users and their teams to stay on top of it all. They can start
conversations, work together on files, and organize around projects. The Yammer app allows Merge1
to hook in and collect data.
Activities Captured
• Posts in public and private groups
• Comments and replies of posts in public and private groups
• Private messages1
• Attachments (including SharePoint files)
• Edit activities of posts/comments/replies/private messages
• Polls2
• Praise (the text of the praise and the replies)
• Announcements (the text of the announcement and replies)
• Deleted private messages, posts, and comments (including attachments)3
Notes
• If messages are GDPR hard deleted, the attachments (if it has any) cannot be captured due to
the source limitation.
• A dummy SMTP address is created for a deleted message which is missing the deleted_by_id
field.
• GDPR hard deleted and soft deleted messages are captured as deleted.
• Legal Hold should be enabled so the attachments are not deleted from the SharePoint site.
For more details on how to enable Legal Hold, see Enable In-Place Hold.
• When sharing an already existing file from SharePoint, the attachment will not be captured -
only the URL of that attachment will be retrieved.
• The created message does not say it was deleted from Yammer. To capture the deletes, the
data retention setting needs to be set to Delete. See instructions at
https://learn.microsoft.com/en-us/yammer/manage-security-and-compliance/manage-data-
compliance#data-retention.
• Events of former members are not captured due to limited permissions of admin-generated
token.
• For files larger than 2 GB, a link for that attachment will be created and included in the body
of the output message with a warning in the log that the file is larger than 2 GB.
• A separate Import folder path should be provisioned on the Source Configuration tab for each
Yammer collector when running 2 or more collectors simultaneously.
297
Merge1 | User Guide
IMPORTERS
• Currently, enabling the Merge messages by thread feature may impact the performance of
the collector processing.
298
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Enter the enter the URL of your local Merge1 environment in the following format:
https://<your_merge1_domain>/Configuration/OAuthCallback. Click
Register.
6. Find and make a note your Application (client) ID and Directory(tenant) ID as this is needed
for configuring the collector in Merge1.
7. In the navigation pane to the left, go to Certificates & secrets.
299
Merge1 | User Guide
IMPORTERS
9. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
300
Merge1 | User Guide
IMPORTERS
2. Click Microsoft Graph, and in the opened pane select Application permissions. Grant the
following permission:
• Application.Read.All
• Sites.Read.All
3. Get back to API permissions section, click + Add a permission and select SharePoint API with
Application permissions. This is the permission you need to grant:
• Sites:Sites.Read.All
301
Merge1 | User Guide
IMPORTERS
Setting Up Yammer
To set up the Yammer collector:
1. Log into your Yammer account at https://www.yammer.com/client_applications.
Please note that the user needs to have an Admin access.
2. Click Register New App.
3. Provide an Application Name, the Organization, the Support e-mail, and add a Website link
and a Redirect URI in the following format: https://
merge1_instance/Configuration/OAuthCallback. Note that the IP address should be used.
302
Merge1 | User Guide
IMPORTERS
4. Click the Continue button and copy the Client ID and Client secret from the opened page.
5. Go to Merge1 and add the Yammer collector by entering Name and Description and then
selecting the collector from the list.
6. In the Application ID field, add the Client ID copied in the 4 steps, and in the Application
Secret/Key add the copied Client Secret.
7. Click NEXT.
8. Allow logging in to the Yammer account, to finalize the collector set up. Make sure that the
pop-ups are not blocked by the browser. You can check that from the top right corner of the
browser address field.
303
Merge1 | User Guide
IMPORTERS
Collector Configuration
Merge1 needs an import folder to download, store and process data from Yammer. This is because
Yammer's APIs are limited in their abilities to send and receive data. The import folder used for
Yammer configuration must be empty for the importer to function properly.
1. To capture SharePoint files, enable the Process files stored in SharePoint checkbox. The
following Azure application credentials are required to capture the content:
• Application (Client) ID
• Directory (Tenant) ID
2. Provide X.509 Certificate Thumbprint in case you activate the Local machine radio button as
the X.509 Certificate source.
304
Merge1 | User Guide
IMPORTERS
3. In case you activate Upload file (*.pfx), click the Select button to upload the certificate and
then provide X.509 Certificate Password.
• Merge messages by thread - this combines all messages in a thread into a single message.
• Select the Message time zone from the drop-down menu. When Process Incomplete Days
option is enabled, the messages of the days that have not yet ended will be imported in a
separate email as well.
• Options Do not download data modified before and Do not download data modified after
allow cutting off data outside the set date range. If the before date is set to 08/17/2022 and
the after date is set to 08/25/2022, only the data between these two dates will be
downloaded. Data outside that timeframe will be ignored. Note that both options can be
used independently as well.
• Subject Prefix - this is added to the subject line of imported emails and is useful for organizing
imported data, i.e., when multiple sources share a common target.
• In the Content capturing section, you can choose either capturing all content or only private
content by enabling the corresponding option.
305
Merge1 | User Guide
IMPORTERS
Note that Light Grid becomes active if the Merge messages by thread is activated.
Attachment Validation
Merge1 enables you to develop customized notes for attachment validation. The default setting is Fail
Messages with missing data set, as a result of which the messages with a specific data chunk that do
not have attachments are failed and can be viewed under the REPORTS.
If you select the Replace missing attachments with the following note and input your custom note, all
the missing attachments of the messages will not be processed, and you will see only the custom
message that you have entered.
306
Merge1 | User Guide
IMPORTERS
Attachments Configuration
For more information on how to configure attachments, see Attachments Configuration.
Splitting Messages
This option allows splitting large files. In the field the size of a split part of the message can be
specified so that each part does not exceed the set size. For example, if the Max Size for each part of
split message is set to 25MB, and the original message is 65 MB, it will be split into 3 messages, each
not exceeding 25MB.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
307
Merge1 | User Guide
IMPORTERS
YIELDBROKER
Yieldbroker is the leading Tier 1 licensed electronic trading platform for Australian and New Zealand
debt securities and derivatives. It is a dynamic collector that brings Banks, Portfolio Managers,
Treasuries and Risk Managers together in a trusted trading environment with unrivalled liquidity and
coverage of the AUD and NZD debt capital markets. Merge1 Yieldbroker collector processes data from
Yieldbroker messages.
Activities Captured
• Participant names and email addresses in the To, From, CC, and BCC fields
• Messages in the body of the output message
• Sender and Recipient company names in the body along with messages
• Thread ID in the message subject
Collector Configuration
For information on how to configure the following sections of the Source tab, see:
• File Source
• SSH Key Authentication
• PGP Configurations
• Folder Configurations
• Miscellaneous Settings
Message Body
This specifies how the imported message will be displayed in the target. The Plain Text mode
organizes the data in a simple way and data displayed in a Light Grid Mode is two-toned, easy to be
viewed with limited metadata.
308
Merge1 | User Guide
IMPORTERS
Parsed output:
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
309
Merge1 | User Guide
IMPORTERS
YOUTUBE
YouTube is an online video sharing and social media platform owned by Google. It acts as a social
network by allowing users with a Google account to watch and upload their videos, comment on
videos, rate and respond to comments, like or dislike videos, etc.
Activities Captured
• Comments/replies of channel discussions
• Comments/replies of videos on channel playlists
• Comments/replies of uploaded videos
• Edits of comments/replies (only the latest version)
• Likes count
• Video view counts
Note that the deleted comments and replies are not captured due to the YouTube API limitations.
310
Merge1 | User Guide
IMPORTERS
4. Once the project is created, click SELECT PROJECT from the Notifications and you are
navigated to the Project page.
311
Merge1 | User Guide
IMPORTERS
5. From the left side navigation menu, select APIs & Services > Dashboard.
7. In the Search for APIs & Services search box, type YouTube Data API v3.
312
Merge1 | User Guide
IMPORTERS
Creating Credentials
313
Merge1 | User Guide
IMPORTERS
5. In the Authorized redirect URIs section, click ADD URI and add the URL of your local Merge1
environment in the following format: https://<
merge1_domain>/Configuration/OAuthCallback and click CREATE, which you can find in the
10 point of the Click information.
314
Merge1 | User Guide
IMPORTERS
6. Copy and save the Client ID and Client ID from the created OAuth client pop-up window.
315
Merge1 | User Guide
IMPORTERS
3. Scroll down to Domain wide delegation section and click MANAGE DOMAIN WIDE
DELEGATION.
316
Merge1 | User Guide
IMPORTERS
5. Enter the above saved Client ID in the Client ID field, add the following scopes in the OAuth
scopes fields:
• https://www.googleapis.com/auth/youtube
• https://www.googleapis.com/auth/youtube.force-ssl
• https://www.googleapis.com/auth/youtube.readonly
• https://www.googleapis.com/auth/youtubepartner
6. Click AUTHORIZE.
Note: By using this importer, you are agreeing to the YouTube terms:
https://www.youtube.com/t/terms, https://policies.google.com/privacy.
317
Merge1 | User Guide
IMPORTERS
Collector Configuration
To set up the collector:
1. Click Add Importer, specify Name and a Description(optional), and select the collector from
the list. The YouTube Application Configuration window will open.
2. In the Application ID field, enter Client ID copied previously, in Application secret/key, enter
the copied Client Secret and click Next.
3. Select the account the content of which you want to capture and click Allow.
For more information, on how to configure this section, see Time Stamp Formatting.
Threading
For Threading:
• If the No threading radio button is activated, only a single message is generated for a
comment or reply.
• If One parent comment with replies is activated, then a threaded message is generated for
comments and replies.
o The Message time zone by which the messages are split based on the selected time
zone from the drop-down menu. When Process Incomplete Days option is enabled,
the messages of the days that have not yet ended will be imported in a separate
email as well. This option can be selected only if One parent comment with replies is
activated.
318
Merge1 | User Guide
IMPORTERS
Message Body
This specifies how the imported message will be displayed in the target. The Basic HTML mode
organizes the data in a simple way and data displayed in a Light Grid Mode is two-toned, easy to be
viewed with limited metadata.
Sample message:
319
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users (N/A)
• Filters
• Targets
• Importer Settings
320
Merge1 | User Guide
IMPORTERS
ZOOM CHAT
Zoom is the leader in modern enterprise video communications, with an easy, reliable cloud platform
for video and audio conferencing, chat, and webinars.
Zoom Team Chat is a messenger which allows users with free and paid accounts to facilitate
communications between Zoom users. With Zoom Team Chat, you can send texts, audio, and video
messages, as well as share files, emojis, screenshots, and so on.
Activities Captured
• Chat messages
• Group chat messages
• Channel messages
• Edits
• Deletes1
• Emojis
• Attachments
• Video messages
• GIFs
Notes
• Chats from the last 6 months only can be captured.
• If the group chat/channel is deleted, the captured output file does not contain a "TO" field.
Thus, no recipients are mentioned.
For Zoom Chat, add the following scopes to the application and click Done:
• User > View all user information
• Team Chat > View all users' team chat channels
• Report > View your team chat history report
Collector Configuration
To configure the collector:
321
Merge1 | User Guide
IMPORTERS
3. In the opened pop-up, confirm the application connection. Make sure that the pop-ups are
not disabled in the browser window.
Timestamp Formatting
For more information, on how to configure this section, see Time Stamp Formatting.
322
Merge1 | User Guide
IMPORTERS
Threading Options
Enable one of the following options:
• No threading - If selected, only a single message will be generated for a message in the
chat/channel.
• Message with replies - If selected, chat/channel messages with all their replies will be
generated.
• Per conversation - If selected, chat/channel messages per conversation will be generated.
Attachments Configuration
For more information on how to configure attachments, see Attachments Configuration.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
323
Merge1 | User Guide
IMPORTERS
ZOOM MEETINGS
Zoom is the leader in modern enterprise video communications, with an easy, reliable cloud platform
for video and audio conferencing, chat, and webinars. The Zoom account used for the Merge1 Zoom
collector needs to be on Business or Enterprise plan to gain access to the API. Note that Pro plan is
not supported.
Activities Captured
• Meeting metadata
• Meeting recording files:
o Audio and video
o Audio
o Audio transcripts
• Meeting chats
Notes
• Only meetings from the last 6 months can be captured. The option to select a longer cut-off
date in the Merge1 UI, has also been disabled.
• Zoom does not support IP addresses as call back URLs.
• To capture the content, the meetings should be recorded. This applies to chats during
meetings too. To enable automatic recording, go to https://zoom.us/profile/setting >
Recording.
• If a message was sent privately to one of the meeting participants, it is not added to the
recording file, as the Zoom API does not provide that option. We recommend disabling the
private messages to be SEC compliant by following this link: https://zoom.us/account/setting.
• Attachments sent during a meeting are not captured. To prevent data loss, the option to
send files via meeting chat should be disabled from the Zoom Meetings UI.
324
Merge1 | User Guide
IMPORTERS
5. Give an app name, choose Account-level app, disable publishing to Marketplace and click
Create.
325
Merge1 | User Guide
IMPORTERS
6. Copy the Client ID and the Client Secret. They will be used later to configure the Merge1
Zoom collector.
7. Under Redirect URL for OAuth and Allow List URL, enter the URL of your local Merge1
environment with the following format: "merge1_instance/Configuration/OAuthCallback". Click
Continue.
326
Merge1 | User Guide
IMPORTERS
10. Add the following scopes to the application and click Done:
• Meeting > View all user meetings
• Recording > View all user recordings
• User > View all user information
• Dashboard > View all users' meetings information on Dashboard.
327
Merge1 | User Guide
IMPORTERS
12. To enable Merge1 to download meeting recordings, the admin must enable Cloud recording
downloads and disable Only the host can download cloud. To do that, go to Account
Management > Account Settings > Recording:
Collector Configuration
To configure the collector:
1. Enter Client ID in the Application ID field.
2. Enter Client Secret in the Application Secret/Key field from Figure 523. Click NEXT.
3. In the opened pop-up, confirm the application connection. Make sure that the pop-ups are
not disabled in the browser window.
Timestamp Formatting
For more information, on how to configure this section, see Time Stamp Formatting.
328
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
329
Merge1 | User Guide
IMPORTERS
Zoom’s Meeting and Webinar Archiving solution allows account administrators to set up an
automated mechanism to collect and archive meeting data to a 3rd party platform of their choice and
hence, satisfy FINRA and/ or other compliance requirements. Only account administrators can
manage what data is archived, what is displayed in the disclaimer, and enable archiving for specific
groups as well. Merge1 uses this API to retrieve archived meeting or webinar chats.
Note that the Meeting Archiving feature is enabled for your account by Zoom Support.
Activities Captured
• Webinar/Meeting metadata
• Webinar/Meeting chats
Notes
• The maximum number of days of archiving is up to 30 days. The number of days can be
specified from the https://zoom.us/account/setting.
• Attachments sent during a meeting are not captured. To prevent data loss, the option to
send files via meeting chat should be disabled from the Zoom Meetings UI.
330
Merge1 | User Guide
IMPORTERS
For Zoom Meetings via Archiving API, add the following scopes to the application and click Done:
• Meeting > View all user meetings
• Webinar > View all user Webinars
• Recording > View all user recordings
• User > View all user information
• Dashboard > View all users' meetings information on Dashboard.
Collector Configuration
To configure the collector:
1. Enter Client ID in the Application ID field.
2. Enter Client Secret in the Application Secret/Key field from Figure 537. Click NEXT.
3. In the opened pop-up, confirm the application connection. Make sure that the pop-ups are
not disabled in the browser window.
331
Merge1 | User Guide
IMPORTERS
Timestamp Formatting
For more information, on how to configure this section see Time Stamp Formatting.
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
332
Merge1 | User Guide
IMPORTERS
Zoom’s Meeting and Webinar Archiving solution allows account administrators to set up an
automated mechanism to collect and archive meeting data to a 3rd party platform of their choice and
hence, satisfy FINRA and/ or other compliance requirements. Only account administrators can
manage what data is archived, what is displayed in the disclaimer, and enable archiving for specific
groups as well.
Merge1 uses this API to retrieve archived meeting or webinar files of an account.
Note that the Meeting Archiving feature is enabled for your account by Zoom Support.
Activities Captured
• Webinar/Meeting metadata
• Webinar/Meeting recording files:
o Audio and video
o Audio
o Closed captions (only if the option is enabled by the user from the Zoom Settings)
• Webinar/Meeting chats
• Recording files as attachments1
Notes
• The maximum number of days of archiving is up to 30 days. The number of days can be
specified from the https://zoom.us/account/setting.
1
A token should be added to download files with the download URLs.
333
Merge1 | User Guide
IMPORTERS
• Attachments sent during a meeting are not captured. To prevent data loss, the option to
send files via meeting chat should be disabled from the Zoom Meetings UI.
For Zoom Meetings via Archiving API, add the following scopes to the application and click Done:
• Meeting > View all user meetings
• Webinar > View all user Webinars
• Recording > View all user recordings
• User > View all user information
• Dashboard > View all users' meetings information on Dashboard.
Collector Configuration
To configure the collector:
1. Enter Client ID in the Application ID field.
2. Enter Client Secret in the Application Secret/Key field from Figure 537. Click NEXT.
334
Merge1 | User Guide
IMPORTERS
3. In the opened pop-up, confirm the application connection. Make sure that the pop-ups are
not disabled in the browser window.
Timestamp Formatting
For more information, on how to configure this section see Time Stamp Formatting.
335
Merge1 | User Guide
IMPORTERS
Next Steps
After setting up the collector, follow the links below to continue with the configuration of:
• Monitored Users
• Filters
• Targets
• Importer Settings
336
Merge1 | User Guide
IMPORTERS
MONITORED USERS
Monitored Users are individuals whose data is collected by Merge1.
There are the following User Sources from where Monitored Users can be added to the collector.
• All (based on native API)
• Active Directory
• CSV File
• Manually maintain the list
• Azure Active Directory
1. Include is used for providing a path to a CSV file or uploading a CSV file with a list of users that
have not been retrieved via API should be included in the Monitored Users.
2. Exclude is used for providing a path CSV file or uploading a CSV file with the users that should
not be monitored as opposed to Include.
337
Merge1 | User Guide
IMPORTERS
When the monitored users' source type is set to All (Based on native API), the Sync button is available
for the following collectors:
• Yammer
• Slack eDiscovery
• Chatter
• Chatter Cipher Cloud
• Microsoft Teams
• Microsoft Teams via Export API
• SharePoint
• Workplace from Facebook
• Dropbox Business
• OneDrive for Business
• Exchange Graph API
To display the SYNC button,the Delete data action is required for the following collectors:
• Citrix Workspace & ShareFile
• Dropbox Business
• Google Drive
• Jabber
• RingCentral
• Skype for Business
• ServiceNow
• Yammer
• Zoom Meetings Chats
• Zoom Chat
Active Directory
Active Directory (AD) is a directory service that Microsoft developed for the Windows domain
networks. Active Directory option allows retrieving a user list using LDAP. Expand Active Directory
Configuration to open it up.
338
Merge1 | User Guide
IMPORTERS
Here are the steps for setting up Active Directory Configuration to import the users:
1. In the Server Name field, fill in the name of the LDAP Server.
2. In the Base Domain field, add the section of the directory where the search should begin,
e.g., ou=finance, dc=example, dc=com.
3. In the Port field, define the Port of the LDAP Server.
4. In the Username field, add the username of the LDAP account.
5. In the Password field, fill in the corresponding password to the LDAP account for signing in.
6. Search Scope defines the scope of the search starting from the Base Domain.
a. Base - only the specified Base Domain should be considered for search.
b. OneLevel - only the immediate children of the specified Base Domain should be
considered.
c. Subtree - the specified entry as Base Domain, as well as all its subordinates should be
considered.
7. In Search Filter, add filters that can be used to restrict the number of users or groups that are
permitted to access an application.
Users who do not have the selected attribute or a Display Name will not be returned by the LDAP
query.
1. Include is used for providing a path to a CSV file or uploading a CSV file with a list of users that
have not been retrieved via API should be included in the Monitored Users.
2. Exclude is used for providing a path CSV file or uploading a CSV file with the users that should
not be monitored as opposed to Include.
339
Merge1 | User Guide
IMPORTERS
CSV File
The CSV file option allows adding our own CSV file based on which the monitored users will be added.
The CSV file should include two columns: email address of the user and display name of the user, both
required. The rest of the columns will be ignored. If the display name is not available, it can be filled
instead with the email address.
1. Include is used for providing a path to a CSV file or uploading a CSV file with a list of users that
have not been retrieved via API should be included in the Monitored Users.
2. Exclude is used for providing a path CSV file or uploading a CSV file with the users that should
not be monitored as opposed to Include.
340
Merge1 | User Guide
IMPORTERS
After selecting Manually maintain the list from User Source Configuration, the below list of monitored
list will become active, where you can make the following changes.
1. Add Monitored User opens a window where you can add details of a user to be monitored.
2. Upload CSV allows uploading a Monitored users’ list as a CSV.
3. Update MU list allows updating the already selected list of monitored users.
4. Delete Selected removes selected users from the monitored list.
5. Sync allows synchronizing with the current data.
6. Search in the list of existing users.
7. Select the user and click Delete Selected. This will remove selected Monitored Users’ list.
8. Edit the information about an existing user.
9. Monitor. If checked, monitors the user, if not, the user is not monitored.
To add a monitored user, click Add Monitored User and fill in the necessary information. The same
information can later be edited by clicking Edit Monitored User as described in point 8.
341
Merge1 | User Guide
IMPORTERS
• Corp Email Address is a required field for the corporate email address of the user.
• Display Name is the name that will be displayed in the Monitored Users list.
• Collector Email/ID is for the email or id of the user’s Collector account.
• Monitor this user option if checked monitors the user and vice versa.
342
Merge1 | User Guide
IMPORTERS
2. Click Upload CSV for uploading the Monitored users’ list as a CSV.
3. Click Delete selected for deleting the below selected list of monitored users.
4. Click the SAVE CHANGES or CLOSE.
343
Merge1 | User Guide
IMPORTERS
1. Specify Application ID and Directory ID. For more details on how to create an app in Microsoft
Azure and grant the permissions, see Microsoft Azure App Creation and Microsoft Azure App
Permissions accordingly.
2. Provide X.509 Certificate Thumbprint in case you activate the Local machine radio button as
the X.509 Certificate source.
3. In case you activate Upload file (*.pfx), click the Select button to upload the certificate and
then provide X.509 Certificate Password.
4. Select User Mapping Property form the dropdown list. Note that User Principal Name always
exists.
5. Enable Get all users checkbox.
344
Merge1 | User Guide
IMPORTERS
• GroupMember.Read.All
• User.Read.All.
345
Merge1 | User Guide
IMPORTERS
Here is the list of collectors for which Monitored Users is not applicable:
• Amazon S3
• Bloomberg
• BlackBerry
• DB
• EML
• FX Connect
• JSON
• Microsoft Teams Meetings
• Redtail Speak
• Symphony
• Text-Delimited
• Refinitiv
• Yieldbroker
346
Merge1 | User Guide
IMPORTERS
• Pivot
• UBS
• XSLT/XML
• XIP
• YouTube.
347
Merge1 | User Guide
IMPORTERS
FILTERS
Filters are used to filter or separate data according to content. They can be configured to match
specific email addresses, XML tags with specific values, or other information using LDAP queries.
2. Enter a Filter Name and select Filter Type. Merge1 has the following filter types:
• Active Directory Filter
• Keyword Filter
• Mail Filter
• XML Filter
• Message Size Filter
• Time Stamp Filter
• Participants Count Filter.
348
Merge1 | User Guide
IMPORTERS
The Active Directory filter matches segments that contain values specified with an LDAP expression.
Values are retrieved each time the importer is run.
1. Search Base sets the starting point for the search in the directory tree. For example, you
might need to query the entire directory, in which case the search base must specify the root
of the directory service. Or you might need to query a specific organizational unit (OU) in the
directory. For example: ou=finance, dc=example, dc=com.
2. Search Scope sets the scope of the search starting from the search base:
• All - all levels inside Active Directory are searched.
• Sub Level - only levels under selected Search Base are searched.
• This Level - only searches the specified by the Search Base level.
349
Merge1 | User Guide
IMPORTERS
3. Search Filter defines search criteria and provides more efficient and effective searches. A
filter specifies the conditions that must be met for a record to be included in the record set
(or collection) that results from a query.
4. When User Address Search Pattern is enabled, the placeholder in the Search Filter field is
replaced with each address that is returned by the Regular Expression (5). The default
expression retrieves values from all objects returned by the Regular Expression and classified
as a User. For example, the following line if input in Regular Expression field, will return all
users with the relevant domain: Z^_a-z{|}~])*@[b | B]loomberg.net$^[-!#$%&’*+/0-9=?A-
Z^_a-z{|}~](\.?[-!#$%&’*+/0-9=?A-
5. In the Regular Expression field, the default expression is input for retrieving values when User
Address Search Pattern is enabled (see pt. 4).
6. If Replace User Address with LDAP Attribute is checked and Replacement Attribute is added
below, it replaces each user’s address with their respective AD attributes as specified.
7. Write the Mail address in this field, that is activated when Replace User Address with LDAP
Attribute is checked (see pt. 6).
8. In the LDAP Server field, fill in the name of the LDAP Server.
9. In the Port field, define the Port of the LDAP Server.
10. In the User Name field, add the username of the LDAP account.
11. In the Password field, fill in the corresponding password to the LDAP account for signing in.
12. Check Enable Caching option if you want to enable saving the query result for future imports.
This will allow skipping searching in the AD during the next Import and will automatically fetch
the cached results.
13. In the Cached Query Count field, specify the number of queries that should be cached.
14. In the Cache Update Interval field, specify the time after which the cached queries should be
updated.
Users who do not have the selected attribute or a Display Name will not be returned by the LDAP
query.
Keyword Filter
Keyword filter allows you to retrieve and refine the data by mentioned keywords and collect it in the
specified target.
350
Merge1 | User Guide
IMPORTERS
Figure 562: Keyword Filter
1. In the Keywords (Comma separated) field, the keywords, by which the data will be filtered,
should be added. The keywords need to be separated by commas for the filtering to work.
Keywords are searched for in the body of the message, as well as in its subject.
2. If Case Sensitive option is checked, only the words with the same case sensitivity as the input
keyword will be filtered. E.g., if you input Direct, it will filter only messages with Direct in their
subjects and/or bodies, the results with direct or DIRECT will not be filtered.
3. Filter can be done being based on the following field(s):
• From
• CC
• Body
• To
• BCC
• Subject
• Custom Header
Mail Filter
Using Mail Filter, you can send the imported data to different targets based on the email addresses in
the TO, FROM, CC, and BCC fields of the imported messages, depending on the fields you specify in
the filter settings. The mail filtering in Merge1 can be static and dynamic.
Static Filter allows uploading a CSV file with email addresses that will be used for filtering. Click Add
from CSV to browse for the necessary list for filtering. The CSV file should include only email
addresses that should be used for filtering.
Dynamic Filter is used to specify email addresses dynamically from an LDAP server or from a CSV file.
This means, that if any changes are applied to the user list in the server or in the CSV file, the filter
settings are refreshed, and values are retrieved newly each time the Importer is run.
351
Merge1 | User Guide
IMPORTERS
Here are the steps for setting up LDAP Server to set up Dynamic Filter:
1. In the Server Name field, fill in the name of the LDAP Server.
2. Enter the Base Domain.
3. In the Port field, define the Port of the LDAP Server.
4. In the User Name field, add the username of the LDAP account.
5. In the Password field, fill in the corresponding password to the LDAP account for signing in.
6. Mark the Use Default Mailbox checkbox to activate/deactivate the Custom Attribute field.
7. Use the Custom Attribute field to extend the search of an asset.
8. Search Scope defines the scope of the search starting from the Base Domain.
• Base - only the specified Base Domain should be considered for search.
• OneLevel - only the immediate children of the specified Base Domain should be
considered.
• Subtree - the specified entry as Base Domain, as well as all its subordinates should be
considered.
9. In Search Filter field, add filters that can be used to restrict the number of users or groups
that are permitted to access an application.
352
Merge1 | User Guide
IMPORTERS
For using a CSV file as a dynamic filter, add the path to the CSV file in the field. If something is
updated in the CSV file, it will be applied the next time the Importer is run.
In the Filter messages larger than/smaller than _ MB, larger than or smaller than should be selected
and the size of messages should be entered:
• If larger than is selected and the size of messages is entered, the messages that exceed that
size will be filtered.
• If smaller than is selected and the size of messages is entered, the messages that are smaller
than that size will be filtered.
353
Merge1 | User Guide
IMPORTERS
The filter is configured based on the FROM, TO, CC, and BCC checkboxes.
Match messages that have _ than X participant(s) is used to filter messages that have more/less than
the specified quantity of participants by choosing less or more from the drop-down list and inputting
the needed quantity of participants.
354
Merge1 | User Guide
IMPORTERS
XML Filter
XML filter allows filtering through XML source data with tags and their specific values.
355
Merge1 | User Guide
IMPORTERS
1. In the Add Tag and Value field, an XML tag and corresponding to it value should be added.
They will be searched for in the body of the message from XML Source and when matched,
will be sent to the assigned target. You can add more than one XML tag and value. After
adding one, click the activated Plus button.
2. If you do not want to input each tag and its value manually, upload a CSV file that includes
tags and their values. Click Add from CSV, browse for the necessary file and upload it.
3. If the added tag and value are matched with a message, that message is sent to the
corresponding target. In the Header section you can add a specific text to be added in the
message header for facilitating future filtering. For example, you can add tags that match by
country and if the tag is matched, the header can be “MessageOriginCountry – USA”. See
example in Figure 570:
Note that only one header can be added to a single filter, so for each country, in this case, a separate
filter needs to be created.
356
Merge1 | User Guide
IMPORTERS
TARGETS
After filling in all the information related to the Filters, click Next and you will be redirected to Targets
tab. You can either fill in the Targets or skip it and fill out later, from the Importer panel under the
Configurations.
Please note that files and attachments, greater than 2 GB are not being processed.
2. Fill in the Target Name and select Target Type from the drop-down menu. Note that these are
mandatory fields.
357
Merge1 | User Guide
IMPORTERS
Output Folder
1. Create New Folder Per Session if enabled will create a separate folder for each time the
Importer is run, named after the date and time of the run.
2. If the Generate manifest file box is enabled, a CSV file is generated that will contain the list of
generated message files.
3. Specify the format of the exported message, EML, MSG or JSON. See the difference between
the file types in the table below.
358
Merge1 | User Guide
IMPORTERS
.eml files can be opened .msg files can only be It is easy for machines to
in a text editor as are opened by MAPI based parse and generate.
like text files. applications.
You can easily convert your .msg file into an .EML file as there could be possibilities where
you want to view an .MSG file but you do not have MS Outlook to open it. .MSG files are
client dependent because they are a proprietary message for Outlook, whereas .EML is a text
- based file representing a message. Therefore, having single messages stored in .EML rather
than an .MSG file proves more beneficial for the users, due to its flexibility.
4. The Remove invalid characters from message headers checkbox is activated by default.
5. Enter the SMTP address in case you want to Replace the empty “To” with an SMTP address in
the corresponding field.
Note that JSON file format is available in all the collectors’ folder target but currently is supported
only for the below listed collectors. For other collectors an error will be thrown.
• Amazon S3
• Box
• Chatter / Chatter Cipher Cloud
• DB (only newly created ones, not upgraded)
• Dropbox Business
• FX Connect
• Jabber Enterprise
• JSON
• Microsoft Teams Meetings
• Microsoft Teams via Export API
• OneDrive for Business
• Pivot
• Redtail Speak
• Refinitiv
• RingCentral
• ServiceNow
359
Merge1 | User Guide
IMPORTERS
• Slack eDiscovery
• Skype for Business
• Symphony
• Text- Delimited (newly created ones, not upgraded)
• Twitter
• Web Page Capture
• Workplace from Facebook
• XIP
• XSLT/XML (newly created ones, not upgraded)
• Yieldbroker
• YouTube
• Zoom Chat
• Zoom Meetings
• Zoom Meetings Chats
• Zoom Meetings via Archiving API
Envelope
The Construct Envelope messages option when enabled envelopes the original output message in a
new message with the From and To email addresses set in the corresponding fields.
The Use a preset FROM and TO in the outer envelope headers option adds the From and To email
addresses of the original output message in the header of the envelope.
The Place BCC users in the TO field option adds the email addresses from the BCC field of the original
output message to the TO field.
The service account that runs the service should have read/write permission for the specified folder.
360
Merge1 | User Guide
IMPORTERS
361
Merge1 | User Guide
IMPORTERS
10. On the left side navigation pane, select Containers (1) and click the name of the container you
want (2).
362
Merge1 | User Guide
IMPORTERS
Below you can find information on how to setup the Direct SMTP Target for your collector.
1. Specify the sender SMTP address that you want to use in the From field. We recommend
using an existing email address so the emails will not be spammed.
2. Specify a destination email address in the To field.
3. When you have filled in all the fields, click Next.
4. When the Place BCC users in the TO field is selected, the BCC emails of the message will be
added to the TO field.
363
Merge1 | User Guide
IMPORTERS
1. To set up an EV target, enter the instance name or IP address of the server that hosts your EV
Directory SQL Server and click Connect to populate the other form fields.
2. After successfully connecting to the database, provide the relevant information from the
drop-down fields click Next:
• Site
• Destination Server
• Vault Store
• Archive
• Retention Category
3. Fill in the fields of the Index Properties section:
• Set
• Name
• Value
Index Properties are used to assign search parameters to data stored in the archive. These
parameters will appear in the Other Attribute Name and corresponding Value fields in Enterprise
Vault Shopping Service.
364
Merge1 | User Guide
IMPORTERS
Note
Merge1 officially supports Domino Journal, Journal Archive and SMTP archives, however, most other
archive types are usually compatible as well.
Note that by default, the value for Vault.MsgType is set to EXCH by Merge1. To change this, add a
new index property with Vault in the Set field, MsgType in the Name field, and the value of your
choice in the Value field.
To include the x-KVSMessageType header, find and enable the option on the SETTING page.
365
Merge1 | User Guide
IMPORTERS
For step-by-step instructions on how to get Application ID, Tenant ID, and Thumbprint, see
Microsoft Azure App Creation and Creating a Certificate (Private and Public Keys) accordingly.
4. Specify a Default Sender address for emails with empty FROM fields (EWS rejects such
emails).
5. Click Connect, to get the folder list.
6. Specify a Target folder for imported data.
7. When you have filled in all the fields, click Next.
Notes
• When checking the Use Exchange Personal Archive checkbox, you will enable Merge1 to
import data to the Personal Archive folder of the Target folder.
• When checking the Construct Envelope Message checkbox, you will enable Merge1 to import
data in MS Exchange journal report format (the X-MS-journal-report header is also added).
To authenticate via OAuth during the collector configuration, you need to create a Microsoft Azure
Application:
1. Login to the Azure Portal using the same credentials as for O365 (Global Admin).
2. Click Azure Active Directory at the top of the page and select App Registration from the left-
side navigation pane.
366
Merge1 | User Guide
IMPORTERS
4. Enter a Name for the application and click the Register button.
5. Enter the enter the URL of your local Merge1 environment in the following format:
https://<your_merge1_domain>/Configuration/OAuthCallback. Click
Register.
367
Merge1 | User Guide
IMPORTERS
6. Find and make a note your Application (client) ID and Directory(tenant) ID as this is needed
for configuring the collector in Merge1.
7. In the navigation pane to the left, go to Certificates & secrets.
368
Merge1 | User Guide
IMPORTERS
9. Select a certificate (public key) with one of the following file types: .cer,.pem, .crt, and click
Add. For more information on how to create a certificate, see Creating a Certificate (Private
and Public Keys).
1. Enter the Username and Password of the target Exchange Web Services account.
2. Specify a Default Sender address for emails with empty FROM fields (EWS rejects such
emails).
3. When you have filled in all the fields, click the Next button.
Info
O365 EWS Target delivers the messages to O365 using the
https://office365ingestionsvc.gble1.protection.outlook.com/service/ThirdPartyIngestionService.svc
endpoint.
When messages are delivered to O365, they're stored in the user's (the user in the FROM field)
Purges folder. This folder is under the Recoverable Items folder and is not accessible by Outlook.
Therefore, all users that are in the FROM or SENDER fields, must have a mailbox in O365, otherwise
the messages will fail to be delivered.
Note that this app is owned by Microsoft and Veritas does not have any control over the permissions
that this app requires.
369
Merge1 | User Guide
IMPORTERS
Notes
• When checking the Use Exchange Personal Archive checkbox, you will enable Merge1 to
import data to the Personal Archive folder of the Target folder.
• Make sure the DNS is properly configured for Autodiscover.
SMTP Target
If you choose an SMTP Target, Merge1 will deliver the data to an SMTP server address you provide.
Below you can find information on how to setup the SMTP Target for your Collector.
1. Specify a destination email address in the To field and a return address in the From field.
2. Enable the Construct Envelope messages checkbox to envelope the original output message
in a new message with the From and To email addresses set in the corresponding fields. The
Use a preset FROM and TO in the outer envelope headers option adds the From and To email
addresses of the original output message in the header of the envelope.
3. Enable Place BCC users in the TO field to add the email addresses from the BCC field of the
original output message to the TO field.
Note: SMTP Target is not recommended for delivering messages to Exchange Online Mailboxes, due
to various throttling policies set by Microsoft. Also, Exchange Online does not accept Journal Envelope
messages which can result in loss of original message time stamps and other metadata.
Notes
370
Merge1 | User Guide
IMPORTERS
• When enabling the Construct Envelope Messages checkbox, Merge1 will import data in MS
Exchange journal report format (the X-MS-journal header also be added).
• When enabling the Place BCC users in the TO field checkbox, Merge1 will move all BCC
recipients to the TO field.
Encryption: SSL and TLS encryption settings should match those of the target SMTP server. Click Test
Connection to check the connection and to ensure that your settings are accurate.
Report Target
The Report Target is used to check whether data can be analyzed successfully. The Importer will list
certain details for viewing in its activity logs. The complete header option includes subject lines, and
everything includes complete headers as well as the messages themselves (Figure 597).
371
Merge1 | User Guide
IMPORTERS
Folder Target
If you choose Folder Target, Merge1 delivers the data to the specified folder in EML, MSG or JSON
formats. Below you can find information on how to setup the Folder Target for your collector.
Output Folder
6. Select the output folder, to where the exported messages will be sent.
7. Specify the format of the exported message, EML, MSG or JSON. See the difference between
the file types in the table below.
You can easily convert your .msg file into an .eml file as there could be possibilities where you want to
view an .msg file but you do not have MS Outlook to open it. .msg files are client dependent because
they are a proprietary message for Outlook whereas, .eml is a text - based file representing a
message. Therefore, having single messages stored in .eml rather than an .msg file proves more
beneficial for the users, due to its flexibility.
372
Merge1 | User Guide
IMPORTERS
8. If the Generate manifest file box is enabled, a CSV file is generated that will contain the list of
generated message files.
9. Create New Folder Per Session if enabled will create a separate folder for each time the
Importer is run, named after the date and time of the run (Figure 599).
10. The Remove invalid characters from message headers checkbox is activated by default.
11. Enter the SMTP address in case you want to Replace the empty “To” with an SMTP address in
the corresponding field.
Note that JSON file format is available in all the collectors’ folder target but currently is supported
only for the following below listed collectors. For other collectors an error will be thrown.
• Amazon S3
• Box
• Chatter / Chatter Cipher Cloud
• DB (only newly created ones, not upgraded)
• Dropbox Business
• FX Connect
• Jabber Enterprise
• JSON
• Microsoft Teams Meetings
• Microsoft Teams via Export API
• OneDrive for Business
• Pivot
• Redtail Speak
• Refinitiv
• RingCentral
• ServiceNow
• Slack eDiscovery
• Skype for Business
• Symphony
• Text- Delimited (newly created ones, not upgraded)
• Twitter
• Web Page Capture
• Workplace from Facebook
• XIP
• XSLT/XML (newly created ones, not upgraded)
• Yieldbroker
• YouTube
• Zoom Chat
• Zoom Meetings
• Zoom Meetings Chats
• Zoom Meetings via Archiving API
373
Merge1 | User Guide
IMPORTERS
•
Envelope
The Construct Envelope messages option when enabled envelopes the original output message in a
new message with the From and To email addresses set in the corresponding fields.
The Use a preset FROM and TO in the outer envelope headers option adds the From and To email
addresses of the original output message in the header of the envelope.
The Place BCC users in the TO field option adds the email addresses from the BCC field of the original
output message to the TO field.
The service account that runs the service should have read/write permission for the specified folder.
2. Enter a name for the project (example: Merge1) and click CREATE.
374
Merge1 | User Guide
IMPORTERS
3. Once the project is created, and there are multiple projects, click SELECT PROJECT from the
Notifications. You will be navigated to the created project dashboard.
Note that if this is the first project created, you will automatically be navigated to the project
dashboard.
375
Merge1 | User Guide
IMPORTERS
5. In the Search for APIs & Services search, box type Gmail.
376
Merge1 | User Guide
IMPORTERS
8. Click Credentials.
377
Merge1 | User Guide
IMPORTERS
11. Enter a name and a description for the service account and click CREATE AND CONTINUE.
12. Select Owner as a role and click CONTINUE, then click DONE.
13. You will be redirected to the page in Figure 614. Click the button and select Manage keys.
378
Merge1 | User Guide
IMPORTERS
16. Once the key is created, you should get prompted to save the file on your computer, save it
somewhere secure, you will need it when configuring Merge1.
379
Merge1 | User Guide
IMPORTERS
17. To grant permissions to the application, go to https://admin.google.com then Security > API
controls.
18. Scroll down to Domain wide delegation section and click MANAGE DOMAIN WIDE
DELEGATION.
380
Merge1 | User Guide
IMPORTERS
20. Open the key file that you saved as JSON above, copy the value of client_id, then paste it in
the Client ID field. Enter https://www.googleapis.com/auth/gmail.insert in OAuth scopes field
and click AUTHORIZE.
381
Merge1 | User Guide
IMPORTERS
Note that you can download the uploaded JSON file by clicking Download. It is active only when there
is a JSON file to download.
In Merge1 you can have one default target and a number of Alternative Targets.
In case you want to make an Alternative target as the Default one next to the X button, you will see
the Default button. Click it and your Alternative Target will become your default and it will be listed
under the Alternative Targets.
382
Merge1 | User Guide
IMPORTERS
IMPORTER SETTINGS
The final step for the Importer Configuration Wizard is the Importer Settings. Under this tab, you will
have the opportunity to configure the following:
• Reporting
• Message Header
• Logging
• Alerting
• Importer Schedule
• Filtering
• Processing
• Advanced Configuration Options.
X-Merge1-Reconciliation-Id. This header is provided by the collectors and corresponds to the id of the
message in the source. In case of EWS collector it is the ID retrieved from Exchange server mailboxes.
Currently, only EWS collectorsets this header. If the Reconciliation Id is not set by the collector, this
header clones the Message-ID header value, which, in turn is generated by Merge1 for each unique
message.
X-MessageSource. Each collectorsets its own value for this header. For example, EWS collectorsets
the value of mentioned header using the user mailbox and mailbox folder name in the following
format: Mailbox:Foldername.
These headers are both in an embedded message and in an enveloped message. Enveloped message
has a different Message-ID from the embedded message. The Reconciliation Id remains the same for
both an embedded message and an enveloped message.
383
Merge1 | User Guide
IMPORTERS
The Enable Message Reconciliation can be enabled only when Audit DB is configured. Otherwise, the
following pop-up will appear:
Report Level
1. Report Level: In Merge1 you will find three types of Report Level, which set the level of
details. You can:
• Generate Summary Report Only. Summary reports include Source Statistics and
Message Statistics. Source Statistics includes the number of unprocessed,
quarantined, failed, and imported sources. Message Statistics includes the number of
unprocessed, failed, successful, excluded, and ignored messages.
• Generate Per-Source and Summary Report. This report type in addition to the
Summary Report includes statistics for each source. For each source there is statistics
for unprocessed, processed, imported, failed, monitored users (if applicable).
• Generate Per-Message, Per-Source and Summary Report. This report is useful only
for file collectors, such as Bloomberg, Symphony, IceChat, Text-Delimited, and others.
The per message report in addition to the reports described above is generated only
in case a message has failed.
Detailed reports are longer and take more time to read. Reports exceeding 5 MB are
shortened.
Reports are different from collector to collector, based on the activities that can be captured
from them.
2. MISC: By enabling the Delete Reported and Archived Sources and Sessions from Database
option, information will be deleted from the database when reports are sent. Deleted figures
will no longer appear in the REPORTS section of the Dashboard.
384
Merge1 | User Guide
IMPORTERS
Message Headers
Message headers are custom headers that are used for labeling and sorting messages.
Note
Filters are not applied to headers generated by these settings.
These settings do not apply to the EML and Exchange Graph API sources.
Logging
Enter a file path in file log folder field. File logs are typically used for troubleshooting purposes. This
field is required.
With File Log Priority the logs are saved in a separate log file and with Event Log Priority the event
Logs are stored in the Windows Event Viewer and is used to avoid third-party tools in Windows. Also,
the latter helps to customize logging process and facilitate monitoring based on requirements.
385
Merge1 | User Guide
IMPORTERS
When choosing logging level Trace, a warning message will appear notifying about possible security
risks with this level of logging. Some sensitive data can be stored in the log as plain text.
The log files do not have a size limit, which means they can grow up to couple of GBs. Files that large
cannot be opened. Therefore, a log file size limit needs to be set. The log file size cannot be
configured through Merge1 UI. However, it is possible to do by adding appropriate appender to the
log config file in the Merge1 installation folder. It is done the following way:
1
In case of Merge1 version 6.0, the path will be C:\Program Files\Globanet Consulting Services\Merge1 6.0\Bin.
386
Merge1 | User Guide
IMPORTERS
4. Specify the size of the log file in the <maximumFileSize value="1KB" /> field. For example,
10MB limit should be specified as <maximumFileSize value="10MB" />
5. Save the file.
As Merge1 is multi-threaded, always allow a +30% threshold between size you set in config file and
actual file size you will see.
Importer Schedule
Here you have the option to choose the Selected Times importer schedule option. This enables you to
set a weekly automated option. Increments are at 15-minute intervals (Figure 630).
Even if the scheduler is enabled, but a time is not selected through Importer Schedule, the job will not
be queued.
Note
The Importer schedules must be re-configured after upgrading Merge1 from 6.0 to 7.0.
387
Merge1 | User Guide
IMPORTERS
Alerting
In this section the option to alert on errors the collector encounters during importing.
There are two levels of alerting:
• Error. Alert is sent when an Error is registered in the logs.
• Warning. Alert is sent when an Error or a Warning is registered in the logs.
You can test the connection by entering Sender Name, Sender Email (preferably and existing one to
avoid the alert being sent to the Spam folder), and the Recipient Email. Click Send Test Email.
Filtering
Filters will not be applied unless filtering is enabled. To enable the filter, enable the Enable filtering
checkbox to configure their behavior (Figure 632).
• Unconditional hit default target: If selected, all data will be delivered to the default target,
even if an alternative target is set.
• Process all filters: When checked, applies filters to the relevant target. In case Match any is
selected, even if one filter matches to a message, the latter is sent to the set Target. If Match
all is checked, all filters must match the message to be sent to the specified Target. For
example, there are two Keyword Filters set with the following names: “Date – February”, “No
Attachment”. If Match any is selected, a message that has only “Date-February” keyword will
388
Merge1 | User Guide
IMPORTERS
be filtered and sent to the target. If Match all is selected, only “Date-February” keyword will
not suffice, the message should correspond to the second filter,” No Attachment”, as well.
In the bottom fields, select the filter name and choose the target from the drop-down menu where
the corresponding messages should be sent. Make sure to click the activated + button to add the
filtering setting, otherwise it will not be saved.
Processing
Processing Options - This option is mostly used for the troubleshooting purpose.
It is advised to use Process Failed Messages Only when there is a big number of failed messages.
If there are problems with connection which lead to failed messages, Process All Messages is the
preferred choice.
If necessary, change this setting to process new segments or failed segments exclusively.
• Attachment is missing - This line is added to the first line of the reprocessed segments with
references to missing attachments.
• Disclaimer is missing - This line is added to the first line of the reprocessed segments with
references to missing disclaimers.
389
Merge1 | User Guide
IMPORTERS
• Strip Group Address Info - This option is selected by default and applies to the EML collector.
With this option, recipients in the header (To, CC and BCC) in an EML file will be removed
upon conversion.
• Set Content-Disposition to inline if missing - This option applies only to the EML source. When
processing EML files that have image attachments, Merge1 will insert any missing Content
Disposition header fields and set their disposition type to inline so that images will appear in
the message body when they are viewed in applications such as Microsoft Outlook.
• Set display name to SMTP address when empty – Enter the SMTP address in the Display
Name fields.
• Match Email Address - The Match Email Address option can match the existing ID or SMTP
Address and replace:
a. SMTP Address
b. Display Name
c. Display Name and SMTP Address
To adjust the Importer's thread pool and optimize it for performance on certain systems you can use
the files Queues and Threads. Additionally, you can set the number of Max target errors, which
indicates how many delivery attempts should fail before the Importer stops (Figure 634).
After you have filled in all the fields in the five tabs you will have to click Save & Finish.
In case you want to make changes in the Wizard, click back and you will be redirected to the last
screen (Importer Settings).
390
USERS & GROUPS
CHAPTER 6
To create a user:
392
Merge1 | User Guide
USERS&GROUPS
2. Assign the user type: Administrator (has full access) or Reviewer (can view only Reports and
Dashboard). Once you select the user type, click SAVE CHANGES.
3. Enable Send Password Email. Note The password should be changed after entering the
temporary password.
Note
To search for a particular user, enter the value of one of the following Active Directory user attributes:
"cn", "samaccountname", "givenname", "sn", or "mail".
This option allows picking a user directly from the users on the device Merge1 is installed on (Figure
638).
393
Merge1 | User Guide
USERS&GROUPS
394
REPORTS
CHAPTER 7
Reports
This chapter represents how to manage the
Reports section.
Merge1 | User Guide
REPORTS
Overview
To view and extract detailed information about the Merge1 user activity and delivery failures, click
Reports in the Navigation pane.
• Audit: View Merge1 user activity.
• Monitored Users: View monitored users by Merge1.
• Unprocessed Messages: View unprocessed messages.
• Target Delivery Failure: View all failed attempts to deliver data.
• Missing Attachment Failure: View all failed messages with missing attachments.
• Missing Disclaimer Failure: View all failed messages with missing disclaimers.
• Data Acquisition Failure: View all failed messages with failed data acquisitions.
For Audit and Monitored Users reports data can be exported as a PDF or CSV file when clicking the
corresponding button on the right side.
The Target Delivery Failure, Missing Attachment Failure, Missing Disclaimer Failure, and Data
Acquisition Failure reports have some of the following functionalities as not all actions are active for
the given report types:
1. Actions
The Reprocessing Options are the following:
• Retry processing. Retries failed messages processing when the importer is run.
396
Merge1 | User Guide
REPORTS
• Force processing - Processes the failed messages when the importer is run and delivers
them to the target without missing data.
• Delete failed messages - Deletes failed messages from DB.
• Skip - Does not process failed messages when the importer is running.
After selecting the reprocessing option, click Apply. The configuration will be applied to the
data stored in DB. Click OK to close the pop-up window.
Important
The Reprocessing Options are applied in pairs with the Importer Settings > Processing >
Processing Options, i.e., Processing Options should also be configured, so the Reprocessing
Options configuration is applied properly.
By default, the Reprocessing option is Retry processing: if not configured by the user, there
will be retries with each session to process the failed messages until data reprocessing is
succeeded.
2. Export Messages
By clicking Export Messages, the report messages will be downloaded as a ZIP file containing
EML, JSON, or TXT files. The files contain all the generated data. Above the message body, the
failure reason is specified with an ERROR status. This functionality is useful in cases when
target delivery failure occurs: the messages can be downloaded here and manually sent to
the archive.
Audit
Many important actions that users make such as logging in or configuring importers, are listed in
Audit (Figure 642).
397
Merge1 | User Guide
REPORTS
• LicenseChanged
• SqlConfigurationUpdate
• TargetAdded
• ConnectorAdded
• FilterAdded
• ImporterAdded
• ComponentSettingsModified
• ImporterServiceStart
• ImporterServiceStop
• TargetRemoved
• ConnectorRemoved
• FilterRemoved
• ImporterRemoved
• NetworkSettingsChanged
• AuditSettingsUpdated
• MessageHeadersSettingsUpdated
• ComponentRenamed
• ComponentDataDeleted
• ImporterDataDeleted
• ManualImportStart
• ScheduledImportStart
• ImporterCloned
• FilterCloned
• ConnectorCloned
• TargetCloned
• UserLoggedIn
• UserLoggedOff
• UserIsCreated
• UserIsDeleted
398
Merge1 | User Guide
REPORTS
• UserUpdatedProfileInfo
• UserTypeUpdated
• ImporterSchedulerEnable
• ImporterSchedulerDisable
• AgentEnabled
• AgentDisabled
• AgentCreated
• AgentDeleted
• AgentUpdated
• MonitoredUserSourceUpdated
• APIClientApplicationAdded
• APIClientApplicationRemoved
• APIClientApplicationChanged
• SmtpServerSettingsChanged
• ImportJobQueued
• ImportJobCanceled
• ImporterSchedulerEnabled
• ImporterSchedulerDisabled
• JITUserIsProvisioned
• JITUserRoleIsUpdated
Unprocessed Messages
The Unprocessed Messages report generates information on messages which have been constructed
and stored in the database, but there hasn't been an attempt to be sent to the target.
Unprocessed messages are reported when:
• A running importer is stopped.
• An importer is force killed before the messages are sent to the target.
Note that to process the unprocessed messages, the Processing Options of Importer Settings should
be configured.
399
Merge1 | User Guide
REPORTS
Information on failed messages with missing attachments is reflected in the Missing Attachment
Failure report.
400
Merge1 | User Guide
REPORTS
Information on failed messages with missing disclaimers is reflected in the Missing Disclaimer Failure
report.
Initially, this report has been constructed for the Yammer collector. According to the configuration,
the Yammer collector gets a date range, which is divided into chunks (a chunk is one hour) and starts
exporting the chunks separately in ZIP files. The ZIP file may or may not contain data depending on
the activity that occurred in the Yammer communication for the specific hour. Data processing in a
chunk (the whole ZIP file export) are reported when:
When the data processing failure occurs, an output message is constructed. The body of the message
contains the start and end dates (separated with ":") of the processing data (chunk), and the failure
type is mentioned as Data Acquisition Failure.
When Merge1 starts running next time is set up to process the failed messages, the messages
(chunks) will be queued to be partially processed (DoPartialProcess for the Yammer collector). The
body is split into 2 parts - start and end date, by which a range (chunk) is created to reprocess.
The log file reflects information on generated data in the form of messages, while those messages are
the chunks, which may or may not contain messages.
401
Merge1 | User Guide
REPORTS
Notes
• In the case of the RingCentral collector data processing also occurs in ranges, however, when
a range (chunk) is failed, it is not considered a Data Acquisition Failure։ the information is only
logged.
• In the case of the Workplace from Facebook and Microsoft Teams via Webhooks collectors,
the Data Acquisition Failure report information is generated differently. Specifically, Merge1
messages are generated from the data stream. When a message is not processed for some
reasons (e.g., the message contains a new body type, the attachment is missing, or the
participant list is absent) the data is stored in the Merge1 DB as a message with the available
data (such as from, time, body, subject and more) and the status is specified as Data
Acquisition Failure. In this case, the quantity of Data Acquisition Failure messages is
equivalent to the number of Unprocessed Messages.
• Only the Yammer collector has a reprocessing functionality. Before reprocessing occurs, the
failed range (chunk) is deleted from DB. When the range fails again, the record is created
again and stored in DB.
402
SETTINGS
CHAPTER 8
Settings
This chapter represents:
• Overview
• Merge1 Settings
• SMTP Server Settings
Merge1 | User Guide
SETTINGS
Overview
To view or configure Settings, navigate to the Settings section of the navigation pane. Settings and
SMTP Server Settings sections show up.
Settings
Database Configuration
1. Click Connect to Database to view the database configuration menu.
404
Merge1 | User Guide
SETTINGS
2. Select an SQL server from the drop-down list or enter one in the same field.
3. Click Connect. The Select Database drop-down becomes active.
4. . When picking Create New from the drop-down list, a prompt appears (Figure 650).
3. Specify a name for the database and click Create. Select the database from the drop-down
menu.
4. Choose between Windows or SQL Server Authentication and enter the Login Name and
Password.
Note
When Windows Authentication is selected, Login Name and Password fields will be disabled
because the credentials entered in Figure 12 during installation will be used.
405
Merge1 | User Guide
SETTINGS
Audit Configuration
Audit Database is used to log the activity performed in Merge1 UI, such as logging in, setting up a
collector, running an importer, etc.
Note that the Enable option should be checked to record the audit logs in the database.
2. To check the Audit logs in the Reports section, select Audits in the Report Type drop-down
list.
406
Merge1 | User Guide
SETTINGS
Note
If your organization uses a proxy server, make sure the address and port information match those of
your browser's proxy settings.
Message Settings
The x-KVSMessageType header is used for e-discovery tasks associated with Veritas™ Compliance
Accelerator and Discovery Accelerator.
Click SAVE SETTINGS to save the settings for the Merge1 Settings.
To set up the SMTP Server settings, enter the required information in the following fields:
• SMTP Server
• Server Email
• Server Port
• Username
• Password
407
Merge1 | User Guide
SETTINGS
If you want to ensure privacy between communicating applications, check TLS required 1.
Click SAVE SETTINGS to save the settings for the SMTP Server.
1Transport Layer Security (TLS) is a cryptographic protocol designed to provide communications security over a computer network. Merge1
supports TLS version 1.3.
408
BRANDING SETTINGS
CHAPTER 9
Branding Settings
Merge1 | User Guide
BRANDING SETTINGS
410
LICENSING
CHAPTER 10
Licensing
This chapter represents:
• Overview
• License Details
• Activating License
• Exporting to PDF
Merge1 | User Guide
LICENSING
Overview
Licenses are distributed for Collector and Target types individually. To activate a component or
components, send the Activation Request Code to Veritas Technologies LLC Support.
When installing Merge1 V7 for the first time, a trial version of Merge1 will be installed offering the
fully functional version of the product for 30 days.
When upgrading Merge1 V6 to Merge1 V7, License Activation Key will be required. To see the
licensing info, navigate to the Licensing section of the navigation pane.
License Details
All license information can be found under License Details:
1. The License Status can be marked as Valid, or the following status will show up:
412
Merge1 | User Guide
LICENSING
6. Enter Activation Code. The field to enter the requested activation code. Click UPDATE to
activate the license.
Activating License
Licenses are distributed for Sources and Target types individually. To activate a component or
components, send the Activation Request Code to Veritas Technologies LLC Support.
In case you fail to see License Status marked as Valid contact the Veritas Technologies LLC Support
team to activate the license.
Note
If you go over the limit of the license of the API-based collectors, Bloomberg, Refinitiv, a warning
message will be generated in the logs. Contact the support team for a new license.
Exporting to PDF
To have the details of the license page in a PDF file click EXPORT TO PDF and Merge1 license info will
be downloaded to your local PC.
413
Merge1 | User Guide
LICENSING
414
API CLIENTS
CHAPTER 11
API Clients
This chapter represents:
• Overview
• Managing API Clients
Merge1 | User Guide
API CLIENTS
416
Merge1 | User Guide
API CLIENTS
Editing an Application
1. Click Edit on the card and a popup will open to edit the application info (Figure 663).
Deleting an Application
1. Click Delete at the top right corner of the application (Figure 665).
417
Merge1 | User Guide
API CLIENTS
Managing Secrets
1. Click Go to Secrets located on the bottom corner of the application card.
2. Add a Secret or a JSON web key (Figure 667) to pass an OAuth authentication (see Registering
an Agent for using the Secret).
Adding a Secret
To add a secret:
1. Click New Secret.
418
Merge1 | User Guide
API CLIENTS
2. In the opened pop-up window, enter a Description (maximum 500 characters in length) for
the secret.
419
Merge1 | User Guide
API CLIENTS
5. After filling in the required fields, click Add and a new card will be added to the page.
Notes
• All secrets are immutable (not editable). Once generated, it will be active until the expiration
date.
• Shared Secrets are stored in the database in a hashed format; hence the system can/will
show it in a plain text mode only at the generation time.
Deleting a Secret
1. Click Delete at the top right corner of the secret card (Figure 672).
420
Merge1 | User Guide
API CLIENTS
2. In the opened pop-up window, enter a Display Name (maximum 500 characters in length) for
the public key and provide a JWK Public Key (maximum 4000 characters in length).
3. After filling in the required fields click Add and a new card will be added to the page.
Note
JWK public keys do not have an expiration period. They are valid until they are deleted from the
system.
421
Merge1 | User Guide
API CLIENTS
Note
JWK Public Keys do not have an expiration period. They are valid until the User deletes them from the
system.
422
JOB MONITORING
CHAPTER 13
Job Monitoring
This chapter represents:
• Overview
• Managing Job Monitoring
Merge1 | User Guide
JOB MONITORING
Overview
This section allows Merge1 root tenant admins to monitor import jobs with their job executions.
Field Description
ID Here the job ID is displayed. Note that you
can use the Copy button next to it to copy
and use it for later purposes.
Scheduler Here the scheduler status (On/Off) is
displayed. The scheduler status can be
changed by enabling/disabling the toggle.
Confirm or discard the status change.
424
Merge1 | User Guide
JOB MONITORING
Field Description
Status Here the job execution status
(Pending/Sent to Agent/Agent
Accepted/Finished) is displayed.
Start Date Here the start date is displayed.
425
Merge1 | User Guide
JOB MONITORING
By selecting the Importer from the drop-down list, only the importer with its job executions will be
displayed.
426
Merge1 | User Guide
JOB MONITORING
427
APPENDIX
CHAPTER 14
Appendix
This chapter represents:
• Creating a Certificate (Private and Public Keys)
• Known Issues
Merge1 | User Guide
APPENDIX
4. Click OK. Once that is complete, you should now see the SSL in the list of Self-Signed
certificates. Now, you have IIS Self-Signed Certificate with 1 year validation.
429
Merge1 | User Guide
APPENDIX
6. Specify the path, type the password, confirm the password, and click OK. Now, you
have exported the Private key.
1. Launch Microsoft Management Console. Press Win+R, type mmc.exe and click OK.
2. Click File and select the Add/Remove Snap-in option.
430
Merge1 | User Guide
APPENDIX
3. Click Certificates in the list of Available snap-ins and then click Add.
431
Merge1 | User Guide
APPENDIX
7. Expand the Personal folder in the left-side menu and choose Certificates.
8. Right-click the certificate you want to export - All Tasks > Export.
432
Merge1 | User Guide
APPENDIX
13. Click Finish and now you have the Public key.
433
Merge1 | User Guide
APPENDIX
Note
CNG certificates are not supported.
434
Merge1 | User Guide
APPENDIX
Known Issues
• In the Citrix Workspace & ShareFile collector, duplicate messages are captured for shared and
then deleted files in case Archive all activities in ShareFile (1) or from the Archive only certain
selection of activities in ShareFile, File share and Text-only messages (2) are enabled.
• In the Microsoft Teams via Export collector, in case of having an error with ‘404 not found’
message for a user when processing messages from Microsoft Teams, the collector will skip
that user and a warning will be logged for later troubleshooting.
References
Please, refer to the following related documents to obtain more information about the system and
how it functions, which can be found in the Documents folder of the downloaded Merge1 7.0 file:
435