DDPV5 Technical Guide Web Gui
DDPV5 Technical Guide Web Gui
1
Contents
1 DDPTechnical Guide 8
7 Desktops 12
7.1 Using DDP with Avid Applications . . . . . . . . . . . . . . . . . 13
7.1.1 To set the desktop to AvidFS on Windows . . . . . . . . 13
7.1.2 To disable AvidFS on the Windows desktop . . . . . . . . 14
7.1.3 To set the Mac to AvidFS . . . . . . . . . . . . . . . . . . 14
7.1.4 To check whether AvidFs has been properly installed on
Mac . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
7.1.5 To disable AvidFS on Mac . . . . . . . . . . . . . . . . . 15
7.2 Using UNC on Windows with ddpvolume and foldervolumes . . . 15
7.2.1 Using UNC with Avid compatibility . . . . . . . . . . . . 15
7.2.2 Using UNC without Avid compatibility . . . . . . . . . . 16
7.3 Force Disconnect/Force Unmount . . . . . . . . . . . . . . . . . . 17
7.4 No Cache . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
8 Network 18
8.1 Bonding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
9 Users 20
9.1 To add a user do the following: . . . . . . . . . . . . . . . . . . . 20
9.2 To add foldervolumes to a user: . . . . . . . . . . . . . . . . . . . 21
9.3 To add extra options to the user: . . . . . . . . . . . . . . . . . . 21
9.4 Admin can disable a user as follows: . . . . . . . . . . . . . . . . 22
9.5 Enlarging the user display window . . . . . . . . . . . . . . . . . 22
10 Groups 22
10.1 To add a Group: . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
10.2 To add users to a Group: . . . . . . . . . . . . . . . . . . . . . . 23
10.3 To add foldervolumes to a Group: . . . . . . . . . . . . . . . . . . 23
10.4 To enlarge the group display window . . . . . . . . . . . . . . . . 24
11 Connect page 24
11.1 Mounting/Unmounting ddpvolume . . . . . . . . . . . . . . . . . 24
11.1.1 Hard Readonly Mounting of ddpvolume . . . . . . . . . . 25
11.2 Mounting/Unmounting FolderVolumes . . . . . . . . . . . . . . . 25
2
11.2.1 Hard Readonly Mounting of foldervolumes . . . . . . . . . 26
11.2.2 Automount . . . . . . . . . . . . . . . . . . . . . . . . . . 26
11.3 When using ddpvolume? . . . . . . . . . . . . . . . . . . . . . . . 28
11.4 When to use Foldervolumes? . . . . . . . . . . . . . . . . . . . . 28
12 Creating a Foldervolume 29
12.1 Create a Folder . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
12.2 Folder to Foldervolume . . . . . . . . . . . . . . . . . . . . . . . . 29
12.3 Assign Data Location and Cache Method to a Foldervolume . . . 30
12.4 Assign a Quota to the Foldervolume . . . . . . . . . . . . . . . . 30
12.5 Data Location, Capacity and Quota . . . . . . . . . . . . . . . . 32
12.6 Recalculate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
12.7 Access Rights on a Foldervolume: Edit Access . . . . . . . . . . . 32
12.7.1 Collaborating on the same project: example Media Com-
poser . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
12.7.2 Access rights using desktop names . . . . . . . . . . . . . 35
12.7.3 Changing access rights at root level . . . . . . . . . . . . 35
12.8 Renaming a foldervolume . . . . . . . . . . . . . . . . . . . . . . 35
12.9 Removing Foldervolume1 and Foldervolume2 . . . . . . . . . . . 36
12.10Benefits of Foldervolumes . . . . . . . . . . . . . . . . . . . . . . 36
12.10.1 Avid edit applications and one namespace . . . . . . . . . 36
12.10.2 Additional Foldervolume vs Folder benefits . . . . . . . . 36
13 Tableview 37
13.1 Sorting of Desktops and Folder volumes . . . . . . . . . . . . . . 37
13.2 Selecting multiple Desktops and Folder volumes . . . . . . . . . . 37
13.3 Searching for Desktops and Folder volumes . . . . . . . . . . . . 37
13.4 Selecting R/W, Readonly, R/W No Delete . . . . . . . . . . . . . 38
14 DDP Volumes 38
14.1 Visible . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
14.2 Archiware, Backup, Archive . . . . . . . . . . . . . . . . . . . . . 39
14.3 SMB Export . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
14.3.1 Selecting shares on a Mac . . . . . . . . . . . . . . . . . . 41
14.3.2 Selecting shares on Windows 7 . . . . . . . . . . . . . . . 41
14.3.3 Selecting shares on Windows 10 . . . . . . . . . . . . . . . 42
14.3.4 Selecting share on RedHat Enterprise Edition . . . . . . . 43
14.4 Status, Capacity, Free, Comment, Type . . . . . . . . . . . . . . 43
15 DDP Folders 43
16 Profile 44
17 R/W Limiting 44
18 Admin Pwd 46
3
19 Trash and Recycle Bin 47
19.1 Trash folder on Mac . . . . . . . . . . . . . . . . . . . . . . . . . 47
19.2 Recycle bin on Windows Vista, 7, 8 and 10 . . . . . . . . . . . . 47
20 LDAP 48
21 Storage 48
21.1 Using the SSD Cache to ingest/copy to using iSCSI/AVFS . . . . 49
21.2 Caching from spindles to SSD . . . . . . . . . . . . . . . . . . . . 50
21.3 Changing the Data Location . . . . . . . . . . . . . . . . . . . . . 50
21.4 Cache Priority . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
21.5 Clear and Clear Cache . . . . . . . . . . . . . . . . . . . . . . . . 51
21.6 How to use Consolidate? . . . . . . . . . . . . . . . . . . . . . . . 52
22 Masterview 52
23 Task Manager 53
24 Event Log 53
25 Raid Check 53
25.1 When having LSI raidcards . . . . . . . . . . . . . . . . . . . . . 53
25.2 When having Areca raidcards . . . . . . . . . . . . . . . . . . . . 53
26 Verify/Repair 54
27 Users Active 55
28 Utility 56
29 Info 56
30 Icon Size 56
31 Archiware 56
31.1 Restore . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
32 E-mails 58
32.1 From . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
32.2 SMTP Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
32.3 Send Event Notifications to the following Email addresses. . . . . 58
32.4 Send Information about the Background Processes to the follow-
ing Email addresses . . . . . . . . . . . . . . . . . . . . . . . . . 59
33 Quota 60
33.1 How to change Quota . . . . . . . . . . . . . . . . . . . . . . . . 60
34 Date/Time 61
35 Language 64
4
36 DNS 64
37 Gateway 64
38 Installers 64
39 UPS 66
40 Connections 67
41 Raidcards 68
44 Nagios 74
45 Remote Diag 74
46 Pwrd/Restart 78
47 DDP Monitor 78
47.1 Event Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . 79
47.2 Background Process . . . . . . . . . . . . . . . . . . . . . . . . . 79
47.3 Monitor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
47.4 Data Locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 79
47.4.1 Capacity Calculation and Usage . . . . . . . . . . . . . . 79
50 Firewall Protection 80
5
51.6 An all 10 and up GbE infrastructure . . . . . . . . . . . . . . . . 82
51.7 1 GbE switch with 10 or higher GbE uplink . . . . . . . . . . . . 82
51.8 Flow Control, Bandwidth Limiting, Traffic Control and Switch
buffer Overrun . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
51.9 Subnet and VLAN . . . . . . . . . . . . . . . . . . . . . . . . . . 83
51.10Teaming, Bonding . . . . . . . . . . . . . . . . . . . . . . . . . . 84
51.11Firewall Protection . . . . . . . . . . . . . . . . . . . . . . . . . . 84
51.12V5 and Clusters and Transparant Failover Solutions . . . . . . . 84
51.13Desktop drivers . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85
51.14Useful . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85
List of Figures
1 DDP WebGui . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10
2 Desktop page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12
3 OneDesktopNotInAvidFsMode . . . . . . . . . . . . . . . . . . . 14
4 V5Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18
5 V5Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
6 Users . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
7 Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
8 Connect page . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
9 Two ways to login . . . . . . . . . . . . . . . . . . . . . . . . . . 27
10 Two ways to loginMac . . . . . . . . . . . . . . . . . . . . . . . . 28
11 Edit Access . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
12 Edit Access select . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
13 Folders for the Workflow . . . . . . . . . . . . . . . . . . . . . . . 37
14 V5Tableview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
15 DDP Volumes Page . . . . . . . . . . . . . . . . . . . . . . . . . 39
16 RWLimiting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
17 AdminLogin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
18 StorageLogic . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48
19 Storage Manager . . . . . . . . . . . . . . . . . . . . . . . . . . . 51
20 Masterview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 52
21 ConsistencyCheck . . . . . . . . . . . . . . . . . . . . . . . . . . 54
22 RaidCheck . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
23 Archiware2Ddpvolume . . . . . . . . . . . . . . . . . . . . . . . . 57
24 Email Settings . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
25 Quota . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
26 DDPTimeserver . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
27 UpS from APC . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
28 Connections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
29 LSIRaidcardEventLog . . . . . . . . . . . . . . . . . . . . . . . . 69
30 RaidCardPageLSI . . . . . . . . . . . . . . . . . . . . . . . . . . 70
31 EventNotification . . . . . . . . . . . . . . . . . . . . . . . . . . . 72
32 Raidcards . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
33 NagiosLSIRaidcard . . . . . . . . . . . . . . . . . . . . . . . . . . 75
6
34 DDP WebGui . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78
7
1 DDPTechnical Guide
Before using this manual please use the V5 Mac, Windows, Linux Technical In-
staller Guide to install the DDP drivers on at least one desktop first. Operating
the DDP is via the the DDP Web based Graphical User Interface. Today each
DDP is delivered with one virtual file system, called ddpvolume. Ddpvolume
covers any storage which is there now or will be added as SSD or HD packs,
DDPEX systems or DDPs. DDP works with the concept of foldervolumes.
These are folders with volume properties so that they can be mounted as a
volumes and also behave as directories or folders within ddpvolume or within a
parent foldervolume.
Currently there can be a total of 512 connections in V5. This
includes also the internal Archiware and SMB connections.
8
can diagnose a problem via our remote connection and advise. When it is a
software bug we will advise to change to V4/V5.
From mid 2016 until Q1 2019 DDP’s were delivered with V4. Starting with
V4 there is only one file system, called ddpvolume and locations which hold raw
data called Data Locations. DDP’s are delivered with the file system created and
customer solely work with folder volumes. Either ddpvolume (the file system)
can be mounted or folder volumes. When ddpvolume is mounted folder volumes
show up as regular folders. V4 uses a stripped down version of XFS plus a
key/value database for the file system. V4 is driver compatible with V3. With
V4 Data Locations must be within a DDP.
From Q2 2019 onwards we released V5 and delivered DDP’s with V5 in-
stalled for new DDP customers. V5 is not driver compatible with V3. So
customers with a V3 DDP buying a new DDP need to either change their V3
DDP to V4/V5 or remain at V4.01.019 version for the time being.
V5 although compatible with V4 largely differs again. The file system now
only lives in the AVFS server and does not show up on the desktop. Instead the
AVFS client includes a raid driver and manages the virtual file system presen-
tation so that ddpvolume and folder volumes show up on Mac, Windows and
Linux (mapping). The AVFS file system is contained in a key/value database
for the inodes, names, parent and attributes and a btree database holding the
directory tree structure. The key/value database with 30 miljoen files an fold-
ers only has a size of less then 10 GB. These are stored in the DOM set and
DDP underneath dummy xattr in Volumes/ddpvolume. The key/value database
is important because directories and bitmaps can be reconstructed from that.
The file system is a 100 GB partition on a raid set. Currently each morning a
copy is made of the databases to the DOM set (for this to happen at least one
internal connection should be there, one mount so that the file system from the
disk partition is accessible). There is also a Postgress database which hold non
file system data, practically all parameters showing via the web interface. Data
Location can now be in different DDP’s or also third party storage arrays. All
components of the file system are in house developed. This step was taken to
develop our transparant failover solution.
9
How to install new versions of Archiware is explained in the Installers
section.
The path /Volumes/ddpvolume on the DDP now contains solely file system
information.
When you do not see icons and fonts using internet explorer then
use one of the other browsers instead.
Also new icon design is part of a V5 installation. After upgradfing to V5 youi
may need to clear the web browser’s history to have the web interface properly
working. The V5 webinterface software now only displays data and does not
contain any logic as such anymore. The webserver uses a Qt model concept
plus additional functionality to service data which the web browser needs. In
practise this no means that the display speed of the web interface does not depend
on the amount of attributes which need to be displayed.
10
6.1 Starting the Web interface
It is assumed that there is an ethernet connection between the desktop and
NIC1 on the DDP and that the desktop is also in the DDP NIC1 default
172.16.5.4/255.255.0.0 subnet settings.
• Press Enter.
• Type Username: admin.
• Type Password: initial. These are the factory set administrator name and
password.
The Home page of the DDP web interface should show up. The interface
has three sections. On the left there is the DDP monitor with the raidcard
event notification indicator, the background process indicator, performance pa-
rameters and a pie showing real time Data Location’s capacities. In the middle
the DDP functions can be found. Each icon in the middle section represents a
DDP page. The Connect page for example is the page where the Desktop icons
and a selection of the ddpvolume and foldervolume icons are shown. On the
righthand side the Workflow Manager with access rights is shown. First thing
to do now is to configure desktops and network.
Although the icons are identical with both V3 and V4 DDP’s. There are
already the following differences between V4 and V3:
11
7 Desktops
This is done in the Desktop page by pressing the Desktops icon. Because we
use iSCSI as block IO communication the desktop name prefix is iqn. So the
format is iqn.desktopname.
• Select Add.
• Enter xxx where xxx is the desktop name. The desktop name must be the
same name which was or is going to be entered in iSCSIPrefs on Mac and during
AVFS driver installation on Windows and Linux.
• Press Apply.
• After restart, login again and select the Connect page. The desktop icon in
the Connect page should be active (not greyed out) and have a green boundary.
12
In V4 and V5 when you select a desktop and then click on the arrow in the
pane below the iqn connections to the Data Locations show including the folder
volume connection
13
Figure 3: OneDesktopNotInAvidFsMode
• Select setupArdisDDPExtras-x64.
• Select Uninstall.
• Press Enter.
• Type: “mount”.
14
7.1.5 To disable AvidFS on Mac
• Select AVFS driver.
• Press Enter.
• Select My Computer and then Network and wait until the AVFS SERVER
icon appears.
15
7.2.2 Using UNC without Avid compatibility
• Unzip the file setupArdisDDPExtras-x64.
• Select
‘‘HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\Services\Avfsd\Parameters’’.
• Select Modify.
• Type AVFS.
• Select My Computer and then Network and wait until the AVFS SERVER
icon appears.
‘‘\\AVFS_Server\DDPdrivename’’
• Select My Computer.
• Select Network.
• See the text: “Ardis Technologies Local Network” It may take a few minutes.
• Select this text. The name
‘‘\\AVFS_Server\DDPdrivename’’
shows up now.
16
• Double click on the AVFS Server icon.
• Type dir
‘‘\\avfs_server\DDPdrivename’’
You can conveniently use the DDP without UNC with standard Avid Edit
software such as Media Composer, Nitris DX, Newscutter and others when the
DDP has been setup according to the procedure above. The familiar green
and red bin locking indications should appear in your Avid applications. Other
Avid applications, Interplay, EVS applications, and others require UNC.
In the latest versions of Avid editors when trying to make a shared
project the question about 3rd party shared storage must be an-
swered with yes to be able to share projects and bins.
7.4 No Cache
When this option is active for a desktop this means that none of the material
accessed by the desktop will be cached On Demand. Backup, archiving, in-
dexing and related processes accesses large number of files. There would be no
point is caching these file on demand.
No Cache is meant specially for desktops used for backup, archive
or indexing purposes
Action selections such as Pinned, Clear, Clear cache and Consol-
idate remain active because these are not desktop related.
V5 has the capability to connect in parallel to the DDPs in a cluster. To
show the status of these parallel connection for a desktop separately a table
opens when the small arrow on the right is clicked after a desktop has been
selected. The number of rows are equal to the number of Data Locations plus
the metadata plus the number of folder volumes mounted. After the connections
to the DLs and the metadata connections are stable the mount of the volumes
happens. The table dynamically displays the status of each.
When a foldervolume is mounted and the desktop is selected and you click on
the arrow in the pane below you will see the iSCSI Connections to the different
Data Locations (ddev) and to the mapping DL (pdev: DL of 50 GB on which
the GPT Headers of folder volumes are managed.) This is specific to V5.
17
8 Network
On standalone DDP Eth0 is the same as NIC1, eth1 is NIC2 etc. On Redun-
dant DDP’s, DDP consisting of DDPHeadM and DDPHeadS, Eth0 stands for
Fallback1, eth1 is the same as NIC1, eth2 as NIC2 and so on.
In the Network page, IP address, subnet mask, the mode (manual, DHCP
or Disabled), MTU and Flow Control can be set per ethernet port. The table
shows these settings. The settings are maintained in the DDP database. To
change or set parameters Name and then Edit must be selected. Changes
become effective when Apply is pressed. When Cancel is pressed before Apply
is activated the changes are undone and the original values are shown again.
The web interface displays messages when violations occur. Current Settings
shows the current real system settings for each port. This is to check if the
database settings are accepted by the system when Apply is pressed. When the
option Disabled in the Configure pull down box is selected and Apply is pressed
the message Disabled appears next to the port name. Although not shown the
IP address is still the same as it was shown before.
Each NIC on the DDP must have a unique subnet.
Figure 4: V5Network
When you try to enter a second IP address in the same subnet an error
message pops up. The option is given to be able to continue because you may
do this on purpose while entering all addresses. Also two Nics can be bonded
to set failover network connection.
The DDP is a SAN system. iSCSI connection is really a SCSI (or SATA
or SAS) block IO connection. This means that the connection is sensitive to
network issues. There is iSCSI and AVFS. AVFS in V5 consists of the Service,
Raid and Filesystem drivers. V3 and V4 drivers all used the same Service
18
driver. Starting with the V5 drivers a much more robust communication protocol
is used in the Service driver. For the highest connection reliability also the DDP
should then run V5. However the majority of network problems arises because
people want to use MTU 9000 for higher bandwidth. But for that to function
properly both endpoint must be set to 9000 and that is not always the case.
Another issue arises from flow control or from situations with two switches in
series creating loops(spanning tree problem). With V5 a message appears on
the screen when the connection is interrupted.
8.1 Bonding
Starting with V5 bonding is implemented. Bonding is not for higher bandwidth
per desktop. It is there for increased up time and increased bandwdith for the
combined setup. For increased bandwidth per desktop MCS, Mutiple Connection
per Sesssion can be used. A third option comes into play with the transparant
failover setup. In that case multipath is used to for the data and our own
protocol for the metadata; AVFS.
Bonding implemented in the DDP is failover based on the 802.3ad (LACP)
protocol. Ethernet packets are always send to a MAC address. The bonding
protocol is between the switch supporting 802.3ad and the DDP. If you bond two
nics there are still two MAC addresses. The bond software decides over which
connection the communication and data runs separately for both directions but
always only one connection is active. It is not meant to increase bandwidth
from/to a desktop but it can be used to double bandwidth between switch and
DDP. The main purpose however to establish a network failover setup between
DDP and switch and or network failover between switch and desktops.
Figure 5: V5Network
To create a Bond
19
• Disable the Nics which are to be bonded.
• Select Create Bond and select the Nics and press Bond.
9 Users
The picture shows the user page.
The DDP shows two factory default DDP users: archiware with password
archiware and smbuser with password smbuser. The user archiware is the DDP
bridge to archiware installed on the DDP and smbuser is the DDP user using
SMB. Smbuser is a standard users of which access rights can be set. When
accidently deleted they need to be created again to keep the Archiware and
Samba functionality. Both users will be further discussed in other sections.
Do not delete Archiware and smbuser
In V4 and V5 a standard SMB server and Archiware server is installed. In-
terfacing to these is via two internal iSCSI client iqn.archiware and iqn.smbuser.
Exactly as you would set it up on Linux desktops. The bandwidth of the inter-
nal socket is managed in the Bandwidth Limiting page. When by accident these
users are deleted they are generated again when the DDP is rebooted.
• Type a name. All lower case and no special characters are allowed.
• Type Password.
• Press Apply.
20
Figure 6: Users
• Select Edit. This can also be done when adding a new user.
• Select Volumes.
• Press Apply.
21
• Select Edit. This can also be done when adding a new user.
• Visible? When enabled the user can decide which foldervolumes show up in
the Connect and Tableview page. This user should pay attention not to
accidently change Visible for others.
• Can Resize? This option has no use anymore. This will be changed in due time
to allow a user to change quota.
• Select Edit.
• Activate Disabled.
• Press Apply.
The settings changed become effective after logout. With disabled active
user settings are kept. The user can not logon to the web interface. The user can
logon to the desktop of course but no foldervolume will appear on the desktop.
The user can logon using the DDP login application but again no folder volume
appears on the desktop.
10 Groups
The picture shows the Groups page.
• Type Group Name. Small all lower case and no special character are allowed.
• Press Apply.
22
Figure 7: Groups
• Select Edit. This can also be done when adding a new group.
• Select Users.
• Press Apply.
• Select Edit. This can also be done when adding a new group.
• Select Volumes.
23
• Press Apply.
When the group access rights are more permissive then the user
access rights the group rights are used. When the group access rights are
less permissive then the user access rights the user access rights are used.
11 Connect page
• Colored desktop icon: the service driver on the desktop has a connection
with the DDP. This mean that ping is possible and the iqn name is fine.
• Green boundary around the desktop icon: the webbrowser uses the same
IP address as the IP address of the iSCSI/AVFS connection.
• : green line: the DDP has concluded that the configuration setup is fine
and has send the V5 mapping. Blue means the opposite. In current
V5.01.009 it does not mean that the mount also happened (which you can see
in the desktop page) In the next release this will be improved)
When selecting the Connect icon the Connect page shows up. Double click-
ing an icon on this screen makes the icons align. When drivers, IP address(es),
desktop iqn name are properly entered after desktop reboot the desktop icon
shows up with a green boundary around it. The moment there is iSCSI commu-
nication between desktop and DDP the desktop icon gets colored (not greyed
out). In addition the icon of this desktop has a green boundary.
On the right side ddpvolume and foldervolume icons are shown when they
are made visible (see DDP Volume page).
When there are more then 50 desktops or foldervolumes in the
system, the connect page icon is greyed out and the Tableview page
must be used.
24
Figure 8: Connect page
The blue line means that an iSCSI session is initiated. When the
line turns green the iSCSI sesssion is valid. It does not necessary
mean that AVFS is active.
25
Be aware that we do not allow simultaneous mount of ddpvolume
and a folder volume. Also we do not allow simultaneous mounting of
a folder volume and its sub folder volume(s).
11.2.2 Automount
It is a bit difficult for users to understand that automount and access right are
different processes.
The process of manual mounting and unmounting described can also occur
automatically via user accounts. This is called automount. There can be for
example just ddpvolume which automounts on all desktops for all users with
the administrator managing user access rights of folders or directories. Or there
can be foldervolumes automounting when a user logs on. The DDP logon/off
mechanism works for Mac, Linux and Windows desktops and all user names
and passwords are managed via the DDP database. A user can log on and log
off on more desktops simultaneously. On each desktop where the user logs on
the designated foldervolumes mounts. When the user logs off the foldervolumes
unmounts.
There is no difference between V3, V4 and V5 regarding this mechanism
when standalone DDPs are concerned.
Changes in automount settings become effective after logout and then login
in again.
There are three automount possibilities:
• Using the DDP web interface (see figure: Two ways to login)
• Using the DDP user acounts app (see figure: Two ways to login)
The first two possibilities expects desktop users names which are not in the
DDP user database. Another user name and password which could be a project
name for example is then used to logon to the DDP. When logon via the web
interface the Connect or Tabelview pages show the user’s desktop and the folder
volumes for which automount was activated. The mount itself still has to be
done. Either by drawing a line in the Connect page or via Add Connection and
selection in the Tabelview page.
Or instead of using the web interface the DDP user name and password can
be entered using the automount application as shown in the picture TwoWaysToLo-
gin. The automount application for the Mac can be opened by clicking on
26
Figure 9: Two ways to login
iSCSPrefs while holding down the Ctrl key or using the right mouse key. On
Windows clicking on the blue DDP icon and then selecting logon or off.
As an example to login wih automount do the following:
• On Windows select the blue DDP icon and on Mac click on iSCSIPrefs
while holding down the Ctrl key or use the right mouse key.
• Select Logon. A window opens where you can enter name and password. The
name and password must be identical to one of the names with password entered
by the administrator into the DDP.
On the Mac full name is displayed when you logon. Not the
account name. Because the DDP database registers credentials and handles
all access rights there is no need for an additional management system.
The last possibility automounts foldervolumes when loging on to the desk-
top. Desktop users then are identical to the DDP user names. Passwords may
differ. Adding/removing users and groups can be done locally or imported and
managed via AD or LDAP. The DDP user list in this case can be synchronized
with AD or LDAP. For access rights AVFS ACLs are used.
27
Figure 10: Two ways to loginMac
28
• selective SSD caching is required.
• an application needs to put a folder right under the root. For example
Avid MediaFiles directory. Each FV can have such directory.
• the operator requires access rights different from a level up the tree.
12 Creating a Foldervolume
12.1 Create a Folder
• Select the Folder volume icon.
• Select New directory.The path shows where the folder is going to be made.
• Press Apply.
• Select ddpvolume.
• Select Create. In the window the folders or directories are listed in yellow.
• Select a folder and press Apply. The folder selected changes from yellow into
the blue foldervolume color.
In V3 and V4 first the folders need to be created on the desktop before the
foldervolume could be created in the Foldervolume page
In the sections to follow we will check or select its Data Location and mode,
set or check SSD cache and mode when there is an SSD pack installed, assign a
quota, check or set automount and set access rights. The next step is to assign
a Data Location to the foldervolume.
29
12.3 Assign Data Location and Cache Method to a Foldervol-
ume
• Select the Storage icon. The Storage Manager page opens.
• Select ddpvolume. Under Cache Method it reads: None and under Data Lo-
cation: Balanced.
• Open the ddpvolume arrow and select the foldervolume. The Storage Man-
ager now reads None (inherit) and Balanced (inherit).
This page does not exists in V3 because of file system reasons given before
The Storage Manager manages SSD and hard disk Data Location assign-
ments to foldervolumes. The DDP delivered could be with hard disks, SSD or
with combination of SSD and hard disk packs. When there is an SSD pack
installed, it can be used as cache (secundary storage) and or as Data Location
(primary storage). The DDP also may have one or more hard disk Data Loca-
tions. The pie below left on the Home page displays the Data Locations with
their total, free and used capacity. The ddpvolume factory setting for Cache
Method is None and for the Data Location it is Balanced. When a folder vol-
ume is made these properties inherit. When a Data Location of a foldervolumes
is altered from balanced to for example HD1 after pressing Apply new files are
written to HD1.
Next step is to assign a quota to the foldervolume.
• When the quota of this foldervolume is set to a value lower then the
system’s free capacity the Quota and Free column are identical and the
30
Capacity column shows all green as long as there is nothing in this fold-
ervolume yet. The quota value is lower then the free capacity and there is
nothing in this folder volume.
• When the quota of this foldervolume is set to a value lower then the
system’s free capacity the Quota and Free column are identical and the
Capacity column shows all green because the data in the foldervolume is
neglectable to the quota value set. The quota value is lower then the free
capacity and the data in the folder volume is neglectable compared to the
quota value set.
• When the quota of this foldervolume is set to a value lower then the
system’s free capacity the Free column value is lower then the Quota
column value and the Capacity column shows a blue section. The quota
value is lower then the free capacity and there is data in the folder volume
which can not be neglected compared to the quota value.
• All capacity calculations are based on the sum of all DL’s exclusing the
cache. When foldervolumes only addresses one of the Data Locations it
is advised to adapt the quota value accordingly. Else the DL may be full
unexpectly.
Initial Quota and the Quota column can be set in percentage or fixed values
as follows:
• Select GB.
• Click on Initial Quota. This is the quota for newly created foldervolumes.
• Type a number.
• Press Set.
• Press Set.
When the value set is reached no files can be added any further unless the
quota is changed. It can be changed on the fly. A quota can have any value.
Each foldervolume can for instance have a quota set to 100 as a percentage.
Then each foldervolume is allowed all available storage with balanced selected.
When the storage is expanded by adding extra groups of disks
or storage arrays the quota is not automatically updated. Please
therefore then in the quota pag active the quota settings by activating
the quota fader for example)
31
12.5 Data Location, Capacity and Quota
12.6 Recalculate
Recalculate is not needed normally. It is used when for some reason the quota
does not seem right. With larger installations and many folders and files it may
take a while before all capacity calculations are as they should be. Recalculate
adds the capacity of all files in the system (used capacity) so it may take some
time and puts a load on the system.
Recalculate only must be pressed once. When recalcuate is pressed
when there is already a recalculate running it starts all over again.
Either the Archiware or SMB active box in DDP Volumes must
be on for Recalculate
Currently we do not calculate the capacity used. Only the free capacity
compared to the DL or DL’s is calculated. Both in V3 and V4 older versions
recalculate is sometimes needed. In V5 it should be fine. It is also important
that in the DDP Volume page Archiware active box is on. It means that there
is always at least one connection which is enough for the DDP to manage the
capacity calculation
32
Figure 11: Edit Access
In the Path Permissions window the access rights are managed. In Edit
access this order is visualized in that desktops are at the top followed by groups
followed by users underneath.. The Permission Preview window displays the
end result.
The access rights in Edit Access are Read/Write, Readonly (file based read
only) and Read/Write without Delete. Settings can be Y, N or - (don’t care).
The access rights inherit downwards to (sub)folders and files until a change in
access level for the user/group combination is reached.
The Edit Access page consists of three subwindows: Name, Permissions
Preview and Path Permisssions. The Name window shows ddpvolume name
and its tree in (sub) foldervolumes and (sub)folders. For convenience files are
not shown. When a folder only contains files and no folders it will not open.
Others are all users, groups and desktops of which access rights have not
actively set.
• Select Others and Press OK. Other shows a dark green color.
• Press Apply.
33
Figure 12: Edit Access select
• Select a user and change access rights by double clicking. Press OK.
• Press Apply.
The same procedure can be followed to set rights per (sub)folder for desk-
tops, groups and other users.
When browsing through folders the colors light or bold green and/or red
show up. The light colors green and red indicate inheritance. The bold colors
green and red indicate that new access rights have been set for that folder or
foldervolume. Access right changes become effective after closing and opening
the folder again. When during a change for example a file copy is running access
right become effective after the file copy is finished.
access rights immediately become effective. Changes in the user,
group and desktop page require unmounting and mounting of ddp
volume or folder volumes to become effective.
34
12.7.1 Collaborating on the same project: example Media Com-
poser
How to setup project access rights when more then one editor should work on
the same project? When Media Composers are used there is no immediate
need for any additional access right management because MC’s automatic bin
locking feature handles read/write and readonly access nicely on a first come
first serve base. But sometimes it maybe necessary to control bin management
on a more permanent basis.
Project files can not be opened from a readonly foldervolume but bins and
media can. It is therefore advised to have project and settings file in a folder
or folders with r/w access. When a bin is opened from a readonly folder or
foldervolume is always shows up with a red readonly icon. Bins and media can
be nicely managed this way.
Do not change access rights on a foldervolume or folder for a user
when that user has the Avid application open.
• Select Remove and then Apply. After a while the foldervolume disappear
from the list.
• Connect ddpvolume to the desktop and rename the folder. In the near
future this can be done directly via the DDP web interface.
35
• Disconnect ddpvolume.
• Select Create, select the folder and press Apply. The foldervolume now has
a name change but users with access rights are kept.
• Select Remove.
• Select Yes.
• Remove the folders from ddpvolume on the desktop.In the near future folders
can be created and removed directly via the web interface.
36
Figure 13: Folders for the Workflow
13 Tableview
The are more options in V5 compared to older versions of V4 and V3
The Connect page shows a graphical representation of the desktops, vol-
umes, foldervolumes and the connections made. Alternatively Tableview can
be selected. When there are more then 50 desktops or folder volumes in the
system the Connect page icon is greyed out and this page must be used. When
Add Connection is pressed the selection window appears.
37
Figure 14: V5Tableview
14 DDP Volumes
DDPs with V5 software are delivered with a virtual file system called ddpvol-
ume. The row starting with Duplicate is obsolete in V5 and will not be discussed
in this V5 manual.
Out of precaution: it is not possible to have ddpvolume and folder-
volume(s) simultaneously mounted on the desktop.
Out of precaution: it is not possible to have a foldervolume and fold-
ervolume made within this foldervolume simultaneously mounted on
the desktop.
DDPs with V5 can not be used with Pro Tools 8.1.1 and older.
DDPs with V5 can not be used with Windows XP, 32 bit.
Foldervolume names must be between 4 and 35 characters. The char-
acter allowed are standard letters (any language - and : and . and
numbers. A foldervolume name is allowed to start with a dot.
38
Figure 15: DDP Volumes Page
14.1 Visible
On the top the DDP Volume page shows ddp and ddpvolume. Both ddpvolume
and foldervolumes can be made Visible so that they appear in the Connect
page and become available in Tableview. Ddpvolume gives a one name space
overview. This visualized in the Workflow Manager section of the web interface
with the tree structure. For a complete overview the administrator should
have ddpvolume mounted on hers/his desktop. Some companies may not be
interested in foldervolumes and hierarchy. In that case all operators just mount
ddpvolume.
39
with a schedule. For a description of how to use Archiware use the Archiware
manual and DDPV4Mirror.pdf.
Select localhost/Archiware/ddpvolume.
Do not select /Volume/ddpvolume. This is the virtual filesystem
which in itself does not carry any capacity. This can corrupt the
system if you do.
• Make sure that smbuser exists The smbuser is created automatically from
software version V4.00.18d onwards during each reboot.
40
• Select Add and for example smbuser, make a selection and press OK.
• Press Apply.
• Press Connect.
• Enter the user name and password.Currently smbuser, smbuser. The name
is fixed but the password can be altered in the Users page. When login in for
the second time this may already show and next step is not needed.
• Press Connect. When there is one share it automatically shows up. If not check
Finder Preferences-General. The check box Connected servers must be activated
there. When more shares are available a list shows up.
Logoff from the desktop also unmounts the share in this case. It is also
possible to use eject.
To logon to the desktop and share with different user names:
41
\\DDPname or IP address.
• Press Enter and open the share icon(s). It may take some seconds.
\\DDPname or IP address.
• Select Enter.A window pops up asking for a user name and password.
\\DDPname or IP
address.
\\DDPname or IP
address.
• Select a folder volume. A windows shows up to in which the smb user name
and password can be entered.
42
14.3.4 Selecting share on RedHat Enterprise Edition
• After desktop logon select Places
• Select Network.
• Select DDP
• Select ddpvolume.
• Select Terminal
• Type the password for this user. After a while the list is shown.
This methods above with Linux can be used to display. The share appears on
the desktop. However a mountpoint has not been given. This can be seen
by typing mount in the Terminal. The command line to give the share a
mountpoint via Terminal is: mount -t cifs//DDP IP address/sharename /mnt/
-o user=username,password=password. In this case the share sharename will
mount under mnt. To unmount a share: type umount /mnt.
15 DDP Folders
This page will be given a new function later on. Currently the page is not in
use.
43
16 Profile
This page is very useful when a V3 or V4 DDP needs to be restarted because
all foldervolumes of mac, windows and linux desktops must be unmounted be-
fore doing the restart. In V5 the DDP can be restarted without unmounting
foldervolumes. On the screen a Connection Lost Reload window with messages
appears. However it often happens that the DDP is back before the different
time outs of the service, avfs and iSCSI are expired. When the DDP is back it
asks the service the status which is still original. In future version this negoci-
ation mechanism will improve further. In that case the desktop needs to logout
and login again.
Profile has two main functions:
• To clear all connections because for some reason the DDP needs to be
serviced and rebooted.
• Select Create.
• Press Apply.
17 R/W Limiting
As explained earlier the bandwidth of the internal socket/iSCSI initiator con-
nection is managed here. When Show System drives is activated in the Utility
page in the BWL page with V4 iqn.aw-smb with the bandwidth set shows up
along with two names archiware-initiator and avfs2nas-initiator. In V5 iqn.aw-
smb has been changed to iqn. name ddp. If there is a need the value of 300
MB/s can be altered.The value set is the maximum bandwidth available to the
desktops using the smb protocol and the desktop using Archiware.
The DDP is expected to sustain sufficient bandwidth to allow playback
without frame drops and recording without unexpected interruptions. Simulta-
neously typical IO processes such as copying or rendering may be active as well.
In contrast to a continuous stream of data such as with playback or recording
processes such as copying or rendering are highly irregular with peak band-
widths only limited by the ports wire speed. A fast render machine connected
44
Figure 16: RWLimiting
may be silent for 1 second and then give a short 1 second burst of data thereby
overloading a shared GbE port for example. The differences between these
two types of behavior can be easily observed by looking at the DDP Monitor.
To control interference between sustained bandwidth and IO processes band-
width limiting can be helpful. The DDP offers bandwidth control on the iSCSI
block IO level. This means that settings of the bandwidth limits are subject
to negotation between the target and the source. This way up and download
bandwidth can be adjusted without any loss of TCP/IP frames. Up and down-
load bandwidth can be set independently per desktop. The procedure is as
follows:
• Select Edit.
• Press Apply.
45
2 times the sustained data rate needed as the upper limit for download. When
there is no recording the upload bandwidth can be lower of course. Data
throughput of a MacPro with a 1 GbE connection with the DDP during ren-
dering or copying can get as high as 117 MB/s or even up to 1000 MB/s when
10 GbE is used. Each DDP is specified to provide a certain throughput. These
throughput must be divided between the sustained streams and other processes.
By limiting the bandwidth of these other processes the total operational band-
width can be kept within the boundary of the DDP specifications.
If MCS is used (see the Connections icon/page) with 2 connections the value to
enter should be half of the value required.
18 Admin Pwd
The figure shows the DDP’s login screen
• Press Edit. You are still logged in as admin with the original password. When
you quit and log in again the new password becomes effective.
The word admin is fixed as admin user. User admin has access to all and
the ability to change everything. User admin can not be removed.
46
19 Trash and Recycle Bin
19.1 Trash folder on Mac
Make sure that the top level is always set to full access rights (YYY)
in Edit Access. The Trash bin on the desktop represents the Trashes folders
from the internal Mac disk but also of ddpvolume and foldervolumes connected
to this desktop when files are moved to the Trash. Each desktop can have a
Trash folder per ddpvolume and or per each foldervolume. Each Mac desktop
has to empty its own Trash. If at one point there is less free capacity then
expected it can simply be because one or more desktops somehow have not
emptied their Trash. Other reasons for this are:
• Make sure the Archiware checkbox in the DDP Volume page is checked.
• When only the Trash of a folder volume must be deleted then select that
foldervolume.
• To delete all Trashes the Trash of each folder volume needs to be deleted
by accesssing the folder volume.
Other files such as .fseventsd are OSX files and not DDP related
*Do not delete ddpvolume. That is the global filesystem.
47
20 LDAP
Via this page the DDP can be integrated with LDAP, OD or Active Directory.
The integration functions with a read only account (non binding). Via this
account user and group names and changes are imported in and synchronized
with the DDP database. This way the Desktop user names are kept in sync with
the DDP user names. Using the DDP web interface for these users and groups
folder volumes must be selected to be automatically mounted (automount) when
loggin in. No passwords are imported and the automount authorisation solely
uses the name only. Details which needs to be known are LDAP server IP
address or DNS name, port number, fully qualified domain name of the ldap
server and the base path for the branch in the domain tree where the user/group
object can be found in the ldap database. The full path needs to be given here.
See for further information the LDAP manual.
21 Storage
This page is not there in V3. It is best to use V5 to get the most of load
balancing and caching.Compared to V4 a number of improvements have been
made in V5. Also in V5 the Consolidate button is now active
48
The Storage page is for the Storage Manager. There is metadata (AVFS)
and data: Data Locations (DL’s). A Data Location is exactly what it says
just a location for the data. In the Storage Manager for ddpvolume or per
foldervolume a DL can be selected or changed. Changing a DL can be done
without any consequences for the front end.
In the figure StorageLogic the possibilities are summarized.
It is also possible to restrict the mode above to certain folder volumes only.
• Select the FV’s and set their DL to Cache and Cache Method to On
Demand.
Using this method files on SSD will be automatically copied through to the
spindles using Balanced. When at some point a file needs to accessed which
has been accessed least until now that file may not be present in the SSD cache
anymore and will then come from the spindles.
It may also be that ingest has been happening directly to SSD cache (DL =
Cache) without write through. In that case when the SSD cache gets full the
data can be moved to the spindles (16 and 17 in table):
• Select FV’s with DL set to Cache.Only select the FVs of which the data must
be transferred.
49
• Set the Cache Method to Pinned.
• Press Apply. In IO Monitor the copying of data from SSD to spindles shows
up.
Pinned, Clear and Clear Cache are action buttons which have im-
mediate effect each time they are pressed and continue until finished.
When On Demand is pressed a queue is build of max 5000 files.
When there are more then 5000 to be cached the oldest ones are
removed from the queue.
IO Monitor shows reading from Cache and writing to spindles. After the
copy is finished IO Monitor shows reading from both Cache and spindles because
the files in the cache are verified with the files on the spindles. Once this is done
the bar changes from grey (locked) to red (pinned). You may need to refresh
the bar display or page. The materials with status pinned can now be cleared
as follows:
After this procedure the red (pinned) selection has turned to green (free).
When Clear or Clear Cache is used files in the Cache which have
no counterpart on spindles are copied to spindles and verified before
the cache clear starts
50
without interupting the workflow. When Apply is selected the location of the
next file to be written changes.
51
Cache must be pressed again.
22 Masterview
When multiple DDP are combined using V5 software the setup is called a DDP
Cluster. All DDPs within a DDP Cluster are managed via one master web
interface. The masterview of the master monitors performance and capacity
parameters and monitors the health of the DDP Cluster and its components.
52
23 Task Manager
The Task Manager is currently being implemented in V5
When Consolidate is pressed a Task is created ((available in a upcoming V5
software update). The Task Manager then shows a list of these active tasks.
Using Add and Cancel they can be added or removed to/from the queue. The
task on the top starts with Start. With Move Up and Move Down the order
can be changed.
24 Event Log
When pressing System Events a few seconds later the status and System events
gathered from the raidcards show up. All events coming from the raidcards are
displayed.
25 Raid Check
All V3 DDP’s werde delivered with Areca raidcard. Also a range of V4 DDP
were delivered with Areca cards type 1882i. At some point in 2017 we changed
to LSI cards type 9361-8i for internal use and the 9380-8e for exterminal. The
reason was that we continued to have (minor) time out issues with the the
chassis we use and the cards. After changing to LSI these issues were gone.
The default setup for most DDP are Raid5 sets of 8 drives for drives up
to 4TB. Raid6 is recommended when drives with 6TB and up are to be used.
The DDP6D has a raid5 set of 6 drives both for audio and video and partly
populated DDPs may also have a different number of drives in a raid set.
• Activate Enable.
53
Figure 21: ConsistencyCheck
• Press Apply.
If you activate Enable and set the Stop Time the checking process halts at
that time. Next time it starts again from the beginning. Also pressing “Stop”
interrupts the check procedure. When “Manual Start” is pressed the process
starts again from the beginning.
In V4 the link of the scheduler to Areca is broken. This has been solved in
the latest V5 version. Or as a workaround it can be scheduled in the raidcard
browser itself
It is adviced to run a raid check monthly.
The check has a low priority so it can continue during a daily oper-
ation. If you feel that it influences the daily operation too much the
stop button can be pressed or the stop can be scheduled
Performance of the DDP can be negatively influenced by a drive just
about to fail due to read retries.
26 Verify/Repair
Verify/Repair icon only appears when Show System Drives is enabled
because currently with V5 this has no function attached to it.
54
Figure 22: RaidCheck
This page is only useful for DDP still using HFS+ (V3 DDP’s). In worst
case scenario’s when these functions would not help Disk Warrior from Alsoft
had to be used on a Mac to repair a volume. With the Ardis file system (V4
and V5) these functions are currently inactivated. When a hard reset is done
a file system check is automatically done when restarting. In the future we’ll
make new verify and repair functions available for V5.
With Verify the file system components of ddpvolume are checked if they
are consistent (not in the software yet). To use Verify or Repair Maintenance
Mode must be on. Switching on maintenance only means that the file system
is not connected to anything, neither externally nor internally. The buttons
AVFS On and Off with DDP with V4 and V5 software version and further have
no function anymore.
27 Users Active
The page Users Active shows which Users are logged on on which desktop.
55
28 Utility
The Utility page allows you to analyse and compare the speed of the different
raidsets with PV Speed Test. With Netstat network statistics can be displayed.
With Clear Log the display field is cleared. With Download System Log the
DDP logfile can be downloaded and send to Ardis Technologies for further
diagnostics. Show/Hide System Drives is a V5 maintenance utility.
The logfiles which can be downloaded here are important to us. Logfiles rotate
after 6 days. It could be that a logfile or logfiles grow very big because of an error
situation. Such a situation can even go unnoticed until the root space (rootfs) is
full and the DDP can not be accessed anymore. You can check this by login to
the DDP and then type df. It is best then after downloading the syslogs to delete
them. They can be found in the var/log directory. In the logfile there are a
number of connection related messages identifiable via the word AUDIT. These
message can be checked using the command zgrep AUDIT /var/log/syslog*. The
audit has the following format example: Oct 21 13:26:22 v4-ssddp42 avfsserv:
1477049182.516156: AUDIT(5) CONNECT ’172.30.5.110’:’iqn.resolve’ user ”
volume ’foldervol2’. Also it shows DISCONNECT. The following is a good test
te see what happens in the logfile during DDP actions. login to the DDP and
do: less /var/log/syslog en then: Shft F ,Ctrl C (to stop), q (to end) ,etc, to
see a running log file while doing stuff. You can of course also search for iqn
names with identical IP addresses or different IP addresses with identical iqn
name
29 Info
This page shows the DDP software version, AVFS software version, the iSCSI
target software version, DDP id and DDP’s serial number dates, login name,
from which IP address, Desktop and Support until.
30 Icon Size
This page allows adjustment of the icon sizes of the desktop and ddpvolume
and foldervolumes icons in the Connect page.
31 Archiware
When planning an Archiware P5 process the Archiware checkbox for ddpvolume
in the DDP Volumes page must be checked. Also check in the User page that
user archiware still exists.
After logon to the DDP select /Archiware/ddpvolume. Do not
select /Volume/ddpvolume. This is the virtual filesystem which in
itself does not carry any capacity. Using this can corrupt the system
The latest version of Archiware is installed on the DDP when delivered and
can be opened by clicking on the P5 icon. The user name and password are the
user name and password also to access the DDP. Before you can use Archiware a
56
license key must be entered. A license key of AWB100, the backup to SAS LTO
tape streamer is free of charge when a DDP is purchased and can be requested
via the DDP dealer or by sending an email to [email protected].
If instead of a standard backup to LTO SAS tape streamer, Archive, Syn-
chronize or Backup to disk, tape libraries or a larger library system is required
it is advised to use a separate desktop with Archiware installed. There are two
possiblitities to setup such system
• With setups with multiple DDPs (DDP Cluster) with upcoming V5 soft-
ware only this option gives parallel access to all DDPs.
57
Archiware runs independently in the DDP. The internal connection between
DDP and Archiware is via the internal iSCSI gateway desktop called: ddpserver
and carries the name of the DDP: iqn.ddpname. This desktop has an internal
iSCSI/AVFS mount of ddpvolume. This desktop internally mounts the ddpvol-
ume or foldervolumes for user archiware and for user smbuser for the internal
samba server.
The desktop iqn.ddpname with connections is shown in the Connect ,Table-
view and R/W Limiting page when in the Utility page Show System Drives is
selected.
The bandwidth for iqn.ddpname is set to 300 MB/s up and down stream.
This is the maximum throughput the internal desktop can deliver. These values
can be changed as follows:
31.1 Restore
When using P5 via the SAS port for restore there is no bandwidth
control so this may disturb other DDP activities.
For regular restore activities it is recommended to use a separate desktop
with Archiware installed on it and ddpvolume mounted.
32 E-mails
Email settings in the DDP use the standard Linux Exim4 program. For notifi-
cations and error reporting Email addresses can be entered in this page.
32.1 From
In this field the DDPs Email address can be entered. When the company name
is Anyname and the email address is [email protected] the DDP address may
be something like [email protected].
• Select Add.
58
Figure 24: Email Settings
• Press OK.
• Select Add.
• Press OK.
59
33 Quota
When the state of ddpvolume changes from unmounted to mounted
the file system is scanned to verify the quota. Depending on the
amount of files this can take minutes
Ddpvolume is unmounted when neither ddpvolume nor any of its folder
volumes is connected and the Archiware and SMB checkbox are not checked.
To prevent unneccessary scanning always check the Archiware
checkbox in the DDP Volume page
On the bottom left the pie shows used, free and total capacity per Data
Location.
• Press Set.
60
The quota setting determines how much capacity is available for each fold-
ervolume separately. When the page opens the foldervolumes show up with
the total and free capacity. The Initial Quota value down below is the initial
value to be used for foldervolumes to be newly created. To change this value a
value must be entered and the Set button pressed. Clicking on a value in the
Quota column enables setting a quota manually. Depending on percentage or
GB selection down below the value is in percentages or a fixed value.
Currently the following need to be considered when using quota:
• The quota can still be useful for folder volumes assigned to a single DL
by setting the GB value lower then the DL’s capacity.
• Total system capacity is the capacity of all DL’s combined without the
cache DL.
The recalculate function is only there in cases where it looks like there is a
mismatch. The recalculate is done for the file system as a whole. The folder-
volume of ddpvolume must have at least a mount for recalculate to function.
There is a mount when Archiware check box is active or when Archiware check
box is not active and at least ddpvolume or one folder volume is connected
to the desktop. Recalculate is an action button and the recalculation may
take some time. Pressing recalculate again before the first is finished start the
recalculation again.
34 Date/Time
It is good practise to connect DDP and desktops to a time server. In fact in an
Avid environment it is a necessity because scanning of the MediaFiles directories
rely upon that. The obvious way is to connect DDP and desktops to the
company time server which connects to an NTP time server. Or alternatively
directly via internet to the NTP time server available for your country. When
that is not possible the NTP Settings field can be left open. When the Time
Server field is left open the DDP can function as a time server. With Add an
IP address can be entered of a known external (NTP) Time Server. The lock is
effective immediately when Apply is pressed. If a DNS server is connected (see
the DNS page for that) also a name can be entered.
To Connect the DDP to a NTP Time Server do the following:
• Select Add.
61
Figure 26: DDPTimeserver
• Press OK.
• Press Apply. In the View window the outcome of the action is displayed.
• Select Remove.
• Press Apply. In the View window the outcome of the action is displayed.
• Set the date and time using the Date and Time tab.
62
• Set the time zone for the location of the Windows Ethernet client.
• Configure the internet time settings with Change settings by entering the
IP address of the time server.
When current time has a large offset compared to the real time,
a time as close as possible to the real time must be manually entered
first.
Mac Client
The following procedure will vary slightly depending upon your Macintosh
OS version. See your Macintosh documentation for information on accessing
System Preferences.
• Select Apple icon, then System Preferences and then Date and Time. The
Date and Time Control Panel opens.
• Click Set Time Zone. A dialog box opens, listing cities and countries. Be
aware that (GMT) means absolute GMT time while (GMT+1) means plus or
minus summer time.
• Select the name of the city and country closest to the client location.
• Close the Date and Time Control Panel to save the settings.
In the DDP web interface only GMT based time zones can be set and does
not take summer/winter time changes into account. To set BST time or correct
for summer/winter time changes please logon to the DDP and use the command
(at command line) dpkg-reconfigure tzdata and select for example Europe and
then for example London or your own region.
As an example it is explained how to set an external time server and use
time zone BST.
63
• Logon to the DDP via ssh root@DDP IP address.
35 Language
Some languages can be selected here.
36 DNS
DNS servers can be entered here. When one of the ethernet ports is set to DHCP
and a DHCP lease has been obtained the current Settings window shows the
DNS IP address. The DNS Servers window is there in case DNS Servers must
be added manually.
37 Gateway
When one wants to route data from one subnet to another a separate router
or gateway or modem must be connected and reachable. The address set in
Gateway is the IP address of that gateway or router. All data with an IP
address not within DDP subnet(s) are forwarded to this address. A Gateway
IP address can be entered manually and must be in one of the subnets of the
DDP.
When one of the ethernet ports is set to DHCP and a DHCP lease has been
obtained the Current Settings window shows the Gateway address (also lease).
It is not possible to enter a gw address for a DHCP connection. To remove the
Gateway please enter 0.0.0.0 and restart the DDP. If a fixed IP address
38 Installers
Do not update or install Archiware on the DDP via an Archiware
server. This corrupts the DDP.
iSCSI drivers can not yet be downloaded here. They can either be used
from the USB stick delivered with the DDP or downloaded from a link provided
by [email protected]. This page is used to upload DDP software to the
DDP. The DDP software comes as .zip file in the format v5.0x.0xx and can be
downloaded from a link provided.
• Press Submit
The window shows the update activity. The update is finished in less then 20
seconds after which the DDP can be rebooted. The DDP version thus uploaded
does not contain Archiware. So this update does not update Archiware. When
64
a newer version of Archiware is available and must be installed the following
actions must be performed:
• Download the proper Archiware version for Linux from the Archiware
website
• Use scp in Terminal on Mac or Putty on Windows to copy the file to /tmp
on the DDP. Example: scp Downloads/awpst541.tgz ssh [email protected]:/tmp/awpst541.tgz
Enter the password:
• tar xpzf /tmp/awpst541.tgz Install Archiware version. xpzf must be user for
tar
When a DDP has been cleanly installed remotely (this happens when the
software is changed from V3 to V4) only DDP software is installed. When
Archiware must be used it needs to be cleanly installed afterwards. This is the
procedure how to do a clean install of Archiware.
• Download the proper Archiware version for Linux from the Archiware
website
• Use scp in Terminal on Mac or Putty on Windows to copy the file to /tmp
on the DDP. Example: scp Downloads/awpst541.tgz ssh [email protected]:/tmp/awpst541.tgz
Enter the password:
• tar xpzf /tmp/awpst541.tgz Install Archiware version. xpzf must be user for
tar
• Continue at option 2
• sh start-server Start Archiware
65
Figure 27: UpS from APC
39 UPS
The function of the UPS is to make sure that when there is a power outtage
the DDP gets a signal from the UPS upon which the DDP halts in a normal
way.
Login to the command line interface of the DDP and type: man apcupsd for
more information. There it is described how to configure the APC UPS. You
can also configure via the web interface APC icon. The easy way is to connect
the UPS via USB. One of the USB connectors at the rear of the DDP can be
used for that.
To enable the UPS with USB:
• Activate Enabled
• Select USB
• Press Apply
To enable the UPS with a serial connection:
• Activate Enabled
• Select Serial
• Enter the Port type The port can be obtained from the APC manual.
To start the APCUPS deamon the DDP requires a restart.
To test if the communication between DDP and UPS functions the following
can be done:
• login to the DDP via ssh using the DDP credentials
• Disconnect the power cords of the UPS
• Check the prints on the terminal screen for errors
Of course also other UPS brands can be used but they may need a Linux
driver installation. Shortly the APC UPS will be monitored via Nagios on the
DDP
66
40 Connections
A portal Group must be defined if you need more bandwidth then 110 MB/s
over a 1GbE network. A Portal Group is a group of at least two ethernet ports
sharing the bandwidth within one session. This is called Mutiple Connection
per Session, in short: MCS. Usable bandwidth with 2 x 1GbE ports is around
150 MB/s. Any number of portals can be made and each portal can contain 2
or more subnet IP addresses. MCS can also be used with 10 GbE.
Only use ethernet ports with fixed IP addresses
Nics on desktops must always be in different subnets
Disconnect the DDP volumes from the desktop before setting up
MCS
Make sure that on Mac in iSCSIPrefs-Options-MaxConnections is
set to 2. If not do so as administrator on the Mac and restart the
desktop
MCS is not supported using iSCSI under Linux
To initialize MCS for 2 x GbE ports on the DDP do the following:
• Select the DDP port. The port over which the desktop communicates.
67
• Select Edit.
• Press Apply.
• Select the other DDP port. The port over which the desktop also wants to
communicate.
• Select Edit.
• Type “1”.
• Press Apply.
• Select the Microsoft iSCSI Initiator (see the appropriate manuals for that)
• Select connections in the initiator and check that Round Robin is selected.
For Mac:
• Open iSCSIPrefs.
• Select Server and in the window enter one IP address of the DDP.Enter
only one IP address of the DDP
• Press Connect and click on the arrow in front of the DDP’s IP address.
• Select the volume and press Disks. Verify that Connections is 2/4 or 2/2. If
not check your installation or change .
41 Raidcards
When a drive or SSD fails the leds of the raidset start to blink, the
event notification in the web interface DDP Monitor becomes red
and blinks and if the Email is properly set an Email is send.
This page adapt itself depending on the raidcard type and number used. The
next chapter explains what to do when a drive or SSD fails. In this chapter
68
general information is discussed. DDP now carry LSI raidcards. So this will be
discussed first.
The drive status and the Event Log of the raidcards is made visible by
selecting System Events in the Event Log page. See the picture. It shows
in the following order: Controller (Raidcard) information, Array information,
Disk information and Event information. With Clear Log the display is cleared.
All information in the picture is from a DDP16D with one raidcard and two
raid 5 sets of 8 x 3 TB drives.
cx = the controller or raidcard ID. DDP8D, DDP16D and DDP24D all have
one raidcard so x = 0, so c0. DDP48D has two raidcards called c0 and c1. ux
= vx = is a virtual drive number or raid set number. Depending on the DDP
configuration there are one or more virtual drive number or raid sets. In this
case there is u0 and u1 so c0u0 and c0u1 identify the raidsets. px = the so
69
called phy. It stands for the physical connection between the backplane and
the disk. sx = slot ID. The slot idea for a DDP16D is labelled s1 to s16. Slot
numbering is from top left (s1) to top right (s4), from next row left (s5) and so
on to bottom right (s16). This scheme is valid for all standalone DDPs except
that the DDP8D end at s8 and DDP24D at s24 and DDP48D at s48. ex =
enclosure ID. Each standalone DDP enclosure in this case the DDP16D has ID
= e8 in this case for the drives and raidsets. But the enclosure itself also has
an ID, ID = e252 (or 0xfc in this case), related to enclosure functions such as
fan speed, power supply and chassis temperature. The drives are labelled in
column Slot ID. The enclosure ID is displayed together with the slot ID for the
drives: 8:s1 to s16; 8:1 to 8:16.
There are many commands available to manage the controller, raid sets and
drives. In the chapter Failing Disk the first line support commands which are
in this page are discussed. All other commands for the raidcard can be accessed
via the StorCLI interface as follows:
70
• Logon to the DDP via Terminal or Putty with ssh root@DDPIPAddress
and then the password.
• Type storcli.
The DDP recognizes which raidcards are used. When LSI the page is as
described. When Areca the Areca page and options show op These raidcards
can be accessed directly via this page. When you press the raidcard button in
the page the browser of the raidcard starts up. The login credentials to get into
the raidcard were on the delivery note which came with this DDP. The Areca
raidcard manual can be downloaded. For anyone who wants to learn more about
the raidcard options. Raidcards communicate with the drives. In addition to
accessing these Areca raidcards via the DDP webbrowser these raidcards in
most cases also have an ethernet port. IE for PC or Firefox on Mac is then
needed. These raidcard’s ethernet port is 100 Mbit/s and the factory settings
are 172.16.5.10x. With x is from 0 to n when there are more of these raidcards.
When the Time Zone is changed in the Date/Time page and Apply is pressed
also the Time Zone of these raidcards are updated. When an NTP server is
added or changed in Date/Time the NTP information in the raidcards is up-
dated as well. The ethernet ports of these raidcards must be connected
and able to communicate with the time server to give an accurate
NTP based time
• Goto the Event log page and press System Events Note ID and Slot:ID. ID
identifies the raidsetnr and Slot ID the enclosure : carrier nr.
71
Figure 31: EventNotification
• Goto the Raidcard page and select controller/enclosure controllers are c0,c1,
enclosures start with e e.g c0/e8.
• Enter the Slot ID in the small pane left (the selector) from Identify
Drive.Number starts with 1 and can go up to 60.
72
• Goto the Event log page and press System Events Note ID and Slot:ID. ID
identifies the raidsetnr and Slot ID the enclosure : carrier nr.
• Goto the Raidcard page and select controller/enclosure controllers are c0,c1,
enclosures start with e e.g c0/e8.
• Enter the Slot ID in the small pane left (the selector) from Identify
Drive.Number starts with 1 and can go up to 60.
• Press Reinsert Disk.
73
• Select Physical Drives
• Select Identify Drive and check whether the proper slot has been identi-
fied.
• Logon to the raidcard using the raidcard logon credentials Now you are in
the Areca raidcard browser.
44 Nagios
The Nagios SNMP server is part of the DDP installation. SNMP traps will
then be served by Nagios. Currently the raidcard(s) and network ports are
implemented via SNMP traps. These SNMP traps are forwarded to the Email
page and to Event Notification on the home page of the web interface. For
bigger installation Nagios or similar SNMP management server product can be
used externally. Integration of an external SNMP application with the DDP is
not part of the delivery unless specifically ordered.
45 Remote Diag
For Redundant DDP’s see the DDPRedundantInstallationGuide how
to setup a Service Connection.
A remote connection to the DDP for Ardis Technologies is manda-
tory for service and support
74
Figure 33: NagiosLSIRaidcard
To setup Service Connection with the DDP Gui using a DHCP server:
Using the preconfigured NIC2 is the most straightforward procedure to setup
a service connection.
75
server. Most internet modems do have a DHCP server on board.
• Make sure port 22 outgoing (ssh port) is open on the Gateway, Modem or Fire-
wall. When you connect to an internet modem port 22 is open as is.
• Type: ssh root@DDP IP address. DDP address which is in the same subnet
as this desktop.
• Type: yes when a question appears where this is required. Does not always
appear.
We describe a setup where cables between NIC1 and NIC2 are connected
to a switch. First make sure that NIC1 is within a different subnet then your
DHCP net. NIC1 is factory set to 172.16.5.4 with subnet mask 255.255.0.0. To
use Terminal or Putty do the following:
76
• Type: ping 172.16.5.4. To check if there is a phyical connection. The screen
shows now: 64 bytes from 172.16.5.4: icmpseq=0 ttl=64 time=0.121 ms or sim-
ilar and on PC: reply from 172.16.5.4 and so on. You can stop the pinging on
MAC with Ctrl C.
• Type: ssh [email protected]. This is to logon to the DDP with user name: root.
• Type: aap (password). When another question pops up first, answer this with
yes. You are logged in to the DDP now.
• Type: ifconfig Eth1. Eth1 is the same as NIC2. If Eth1 does not show an IP
address type: ifup Eth1 and check ifconfig again. This way there is no need to
restart the DDP each time while doing this.
• Enter the IP address of the desktop as the Gateway address in the DDP
via DDP Gui and Settings page.
• Connect the desktop with the proper port to the DDP (same subnet
different IP addresses).
77
A wireless connection may not be fast enough for a large software
update of the DDP
For service a remote connection which allows access to the DDP for
diagnostics and update purposes is mandatory
46 Pwrd/Restart
The DDP can be powered down or restarted here. Alternatively when you press
the power down button on the front of the DDP shortly the DDP powers down
normally as well. There maybe a situation when the DDP does not react to
the remote power down or the short pressing of the power down button on the
front of the DDP (crash situation). In that case please keep the power down
on the front of the DDP pressed until the DDP switches off. Then switch the
DDP on again and contact your dealer or Ardis Technologies. Restart reboots
the DDP in a normal safe way.
With V5 the DDP can be rebooted without unmounting drives on the desktop.
Although it is advised after the return of the DDP to logout and login again.
47 DDP Monitor
78
47.1 Event Notifications
Normally the indication shows green. This means that the event notification
of the raidcard(s) is enabled but no events are generated. You can observe this
by clicking on the green indicator. When an event occurs the green indicator
starts to blink red. Clicking on it shows the event which has occurred. To check
in depth what the reason of the event is select the Event Log icon and then
press System Events.
47.3 Monitor
The DDP monitor shows a time based overview of the sustained Bandwidth,
IOPs or Streams. These parameters are displayed separately for Disks, Data
Locations, Network and DDP IP address.
The Data Scale can be set to Autoscale meaning that the peak determines
what the scale is. When the display mode Bandwidth is selected the Data Scale
can be used to fix the scale at a certain level. The Stream Count option divides
the Bandwidth by the selected stream bandwidth. When Streams is selected
the number of streams is shown.
79
and on Mac 21 TB. In addition it is also good practice to keep approximately
10 percent of the total capacity free. So the actual usable capacity will then be
around 17 TB.
50 Firewall Protection
When there is a need to use a firewall between DDP and desktop the following
ports must be enabled for the DDP to properly function. Port 80,81, 3260, 1565,
1567, 1568, 1569 and 1570. When working with Avid edit applications is maybe
good te disable such firewall entirely. To work with Archiware port 8001 must
be enabled. For service connection port 22 outgoing must be available.
80
Teamviewer desktop is a possibility as well. Also for some probably security
reason only TV 10 properly works at Ardis
51.2 Network
All endpoints on a connection must have the same MTU setting. In practise
specially when MTU = 9000 is used . In almost all installation there is at
least one desktop with the wrong MTU setting or with a flacky connection. You
should always use ping from DDP to desktop and from desktop to DDP to check
the MTU setting. both sides. In linux/mac: ping -s 9000 ¡IP address¿ In
Windows ping -l 9000 ¡IP address¿ Ping also shows the roundtrip time which
should always be less then 1ms.
There is often the situation that two desktops have the same iqn name or
the same IP address. It can also happen specially when DHCP is partly used
that two DDP IP addresses are in the same subnet. This can be checked when
looking at the logfile.
81
51.5 A 1GbE infrastructure
When solely a 1GbE/RJ45 infrastructure is available or installed simple stan-
dard unmanaged 1GbE switches from brands such as Cisco budget series, Net-
gear, SMC and many others can be used. Of course managed switches can
also be used. Unmanaged switches sense what the settings of the endpoint are
and act accordingly. Although most unmanaged switches may suppport jumbo
frames (9000 size package) it is not always guaranteed. It is recommended in
general not to use jumbo frames with an all 1GbE infrastructure because it is a
setting which can easily be overlooked causing unexplanable intermittant prob-
lems. When an application such as EVS for example strongly benefits from using
jumbo frames, jumbo frames can be enabled on all components of the subnet.
Flow control must be enabled on all ports and spanning tree must be switched
off.
82
10 GbE bandwidth will still be okay. In larger and or critical installations Ardis
Technologies can enable Traffic Control. With proper use of Traffic Control
and flow control enabled on 10 GbE line, the 10 GbE bandwidth remains intact
and retransmission are absent. See further for an explanation of flow control,
bandwidth limitation and traffic control.
83
51.10 Teaming, Bonding
Teaming and bonding are terms used for the same. On desktops with two NICS
these can be setup as behaving as one IP address. That way two ethernet lines
go to a switch. When one line fails the communication still continuous via
the other line. This teaming is transparant to our desktop software such as
the iSCSI initiator and AVFS metadata controller driver because it is setup at
the TCP/IP level. On request the DDP can be delivered with 10 GbE failover
ports to enable the same robustness but then on a 10 GbE connection between
DDP and switch. Teaming gives more robustness but there is no increase in
bandwidth.
Separately DDP support Multiple Connection Per Session (MCS) which does
create a doubling of bandwidth. MCS is switch transparant. Groups of IP ports
(portal groups) are defined in the DDP and desktops operating within these
subnets have increased bandwidth with two or more connections. The iSCSI
commands are scheduled over the multiple lines.
84
arays solely communicates via iSCSI with the desktops. So a minimum of 4
DDP IP addresses and a minimum of 2 iqn names must be entered per desktop.
The IP addresses can all be in the same subnet via one ethernet cable or via
two cables (using bonding between switch and desktops) or using two cables over
two subnets. Multipathing is used for data failover and the AVFS has its own
protocol to switch during a metadata failover. For V5 it is relevant whether
data transfer is via iSCSI, SAS, FC or Infiniband. In practise there will be
situations where FC Storage which is already present must be integrated in a
setup. There maybe also situations where apart from the dual DDP Heads als
storage arrays are from Seagate, HP, Dell etc.
51.14 Useful
The NIC of a Mac with the latest Adobe software and DDP drivers when us-
ing the GPU for rendering on a ddp volume may become inactive. When that
happens the Mac has to be restarted again.
Currently the DDP does not support hard links.
85