M3GuideTransforms PDF
M3GuideTransforms PDF
Maltego transforms
A reference guide
RT
2011/01
January 2011
Version 3.0
Table of Contents
1
Introduction ...................................................................................................................................................................... 7
2.1
2.2
Infrastructure ................................................................................................................................................................ 10
3.1
3.1.1
3.2
3.2.1
3.2.2
3.2.3
3.3
Domain ...................................................................................................................................................................................................13
3.3.1
3.3.2
3.3.3
3.3.4
3.3.5
3.3.6
3.3.7
3.3.8
3.3.9
3.3.10
3.3.11
3.3.12
3.3.13
3.3.14
3.3.15
3.3.16
3.3.17
3.3.18
3.3.19
Page 2
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
3.4
An IP version 4 address ...................................................................................................................................................................29
3.4.1
3.4.2
3.4.3
3.4.4
3.4.5
3.4.6
3.4.7
3.4.8
3.4.9
3.4.10
3.4.11
3.4.12
3.4.13
3.5
3.5.1
3.5.2
3.5.3
3.6
3.6.1
3.6.2
3.6.3
3.6.4
3.7
Netblock .................................................................................................................................................................................................43
3.7.1
To AS number ............................................................................................................................................................................43
3.7.2
3.7.3
3.7.4
3.8
URL...........................................................................................................................................................................................................46
3.8.1
3.8.2
3.8.3
3.8.4
3.8.5
To Website [Convert]..............................................................................................................................................................50
Page 3
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
3.8.6
To Website [Links on this web page] ...............................................................................................................................50
3.9
Website...................................................................................................................................................................................................51
3.9.1
3.9.2
3.9.3
3.9.4
3.9.5
3.9.6
3.9.7
3.9.8
Personal ........................................................................................................................................................................... 57
4.1
Document ..............................................................................................................................................................................................57
4.1.1
4.1.2
4.2
Email........................................................................................................................................................................................................59
4.2.1
4.2.2
4.2.3
4.2.4
4.2.5
4.2.6
4.2.7
4.2.8
4.2.9
4.3
Person .....................................................................................................................................................................................................64
4.3.1
4.3.2
4.3.3
4.3.4
4.3.5
4.3.6
4.4
4.4.1
4.4.2
Page 4
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
4.4.3
To URL [Show Search Engine results] .............................................................................................................................71
4.4.4
4.5
Phrase .....................................................................................................................................................................................................72
4.5.1
4.5.2
4.5.3
4.5.4
4.5.5
4.5.6
4.5.7
4.5.8
4.6
Twit ..........................................................................................................................................................................................................80
4.6.1
4.6.2
4.7
4.7.1
4.7.2
4.7.3
4.7.4
4.7.5
4.7.6
4.7.7
4.7.8
Infrastructure ......................................................................................................................................................................................88
5.1.1
5.1.2
5.1.3
Internet Domain........................................................................................................................................................................89
5.1.4
5.1.5
5.1.6
5.1.7
5.1.8
Netblock .......................................................................................................................................................................................92
5.1.9
URL .................................................................................................................................................................................................92
Page 5
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
5.1.10 Website .........................................................................................................................................................................................93
5.2
Personal .................................................................................................................................................................................................93
5.2.1
Document.....................................................................................................................................................................................93
5.2.2
Email ..............................................................................................................................................................................................94
5.2.3
Person ...........................................................................................................................................................................................94
5.2.4
5.2.5
Phrase............................................................................................................................................................................................95
5.2.6
Twit ................................................................................................................................................................................................96
5.2.7
5.2.8
5.2.9
Page 6
January 2011
Version 3.0
Introduction
This document serves as a reference guide of transforms that are currently in use in Maltego. The last section
of this document gives a summary of all transforms.
Page 7
January 2011
Version 3.0
There are couple of transforms that use search engines - all of them very similar. The basic recipe with these
transforms is as follows:
1. Expand the question. The question is the input from the GUI - be that a person's name, a domain or an
phone number. When looking at a person's name for instance the name 'Kosie Kramer' will be
expanded to searches like '"Kosie Kramer"', '"K Kramer"', 'Kramer Kosie' etc. In the case of a telephone
number the search will be expanded to include most telephone notations used.
2. Assign confidence levels. Because a search for '"Kosie Kramer"' is more likely to return good results rather than a search for 'KramerK' the confidence level for the first search would be higher. The
confidence levels are also used to assign preference to certain file types when doing searches on
documents (these are configurable in the transform). In the same way a XLS file containing the word is
likely more interesting than a PDF file.
3. Perform each search. The searches are performed and the snippets are obtained. It is important to note
that only snippets are parsed. For parsing the entire page you need to dump to URL and process the
URLs separately. Various search engines have various snippet lengths.
4. Parse for output entities. Depending on what output is required the snippets are parsed for entities - in
some cases the web site's name is all that's required.
5. Calculate weight. The weigh is calculated from various factors - the confidence of the search, the
frequency of the result, the importance of the web site where the result came from, and in some cases a
correlation to the input.
6. Normalise. The weights are now normalised using a fairly interesting algorithm that involves the mean
and standard deviation of the spread of weights. It is important to understand that a search result with
a equal spread of weights are mostly useless.
2.1
Maltego will sometimes give you results that seem plain wrong. You need to keep in mind that the application will
get pretty desperate when it does not get results. So - when you are searching for a person called "Vaxynutus
Grabounill" and that person simply left no marks on the Internet Maltego will eventually go after a search term
"VG" - with a super low confidence - but you will still get some results. These results could seem completely off the
mark, but should have very low weights. Always look at the weights.
Many of the search engine transforms use pop-up transform settings for location and additional terms. If you are
not getting the results you want you should try adding some terms here. You can read all about it in the User guide
in the section about Transform properties.
Maltego Transforms a reference guide
Page 8
January 2011
2.2
Version 3.0
Some entities are hard to parse. Telephone numbers are notoriously hard to parse. There is always a trade-off
between missing numbers and parsing non-telephone numbers as phone numbers. With the current transforms
we hope to have reached the optimal balance.
Page 9
January 2011
Infrastructure
3.1
Version 3.0
Page 10
January 2011
3.2
Version 3.0
NS (Name Server)
Page 11
January 2011
Version 3.0
Page 12
January 2011
3.3
Version 3.0
Domain
Page 13
January 2011
Version 3.0
Page 14
January 2011
Version 3.0
Page 15
January 2011
Version 3.0
Page 16
January 2011
Version 3.0
Page 17
January 2011
Version 3.0
Page 18
January 2011
Version 3.0
Page 19
January 2011
Version 3.0
Page 20
January 2011
Version 3.0
Page 21
January 2011
Version 3.0
Page 22
January 2011
Version 3.0
Page 23
January 2011
Version 3.0
Page 24
January 2011
Version 3.0
Page 25
January 2011
Version 3.0
Page 26
January 2011
Version 3.0
Page 27
January 2011
Version 3.0
Page 28
January 2011
3.4
Version 3.0
An IP version 4 address
Page 29
January 2011
Version 3.0
Page 30
January 2011
Version 3.0
Page 31
January 2011
Version 3.0
Page 32
January 2011
Version 3.0
Page 33
January 2011
Version 3.0
Page 34
January 2011
Version 3.0
Page 35
January 2011
Version 3.0
Page 36
January 2011
Version 3.0
Page 37
January 2011
Version 3.0
Page 38
January 2011
3.5
Version 3.0
MX record (mail
record))
(mail exchange record
Page 39
January 2011
Version 3.0
Page 40
January 2011
3.6
Version 3.0
Page 41
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
can find all (or most) of these domains. A word of caution - if the target is hosting its name servers at an ISP
then you will end up with a list of domains that hosted by the ISP - normally not the most exciting result.
Page 42
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
etblock), but, in reality are only
transform is that an organization might have a class B network (a fairly large netblock),
using a couple of class Cs (smaller netblocks) within that block. In many cases they will only populate the
reverse DNS of these smaller blocks and delegate it to their name servers. The transform will show these
smaller blocks.
3.7
Netblock
3.7.1 To AS number
This transform determines the Autonomous System (AS) number of the supplied network. This is useful for
determining if two (or more)
ore) networks are related. If two networks are in the same AS (e.g. have the same AS
number) we can say they are at least loosely routed to the same destination. If the networks belong to an
organization (as opposed to belonging to an ISP that is splitting the network into smaller networks and leasing
them to clients) we get a good indication that both networks belong to the same organization.
Page 43
January 2011
Version 3.0
Page 44
January 2011
Version 3.0
Page 45
January 2011
3.8
Version 3.0
URL
Page 46
January 2011
Version 3.0
Page 47
January 2011
Version 3.0
Page 48
January 2011
Version 3.0
Page 49
January 2011
Version 3.0
Page 50
January 2011
3.9
Version 3.0
Website
Page 51
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
as will sites with exotic JavaScript menus and redirects. Email addresses that are obfuscated using nonstandard techniques will also not be picked up.
Page 52
January 2011
Version 3.0
Page 53
January 2011
Version 3.0
Page 54
January 2011
Version 3.0
Page 55
January 2011
Version 3.0
Page 56
January 2011
Personal
4.1
Document
Version 3.0
Company->Phrase
Creator->Phrase
Keywords->Phrase
Author->Person
LastSavedBy->Person
AuthorEmail->Email address
AuthorEmailDisplayName->Email
>Email address
Page 57
January 2011
Version 3.0
Page 58
January 2011
4.2
Version 3.0
Page 59
January 2011
Version 3.0
Page 60
January 2011
Version 3.0
Page 61
January 2011
Version 3.0
Page 62
January 2011
Version 3.0
Page 63
January 2011
4.3
Version 3.0
Person
Page 64
January 2011
Version 3.0
Page 65
January 2011
Version 3.0
Page 66
January 2011
Version 3.0
Page 67
January 2011
Version 3.0
Page 68
January 2011
Version 3.0
Page 69
January 2011
4.4
Version 3.0
Phone Number
Page 70
January 2011
Version 3.0
Page 71
January 2011
Version 3.0
4.5
Phrase
Page 72
January 2011
Version 3.0
Page 73
January 2011
Version 3.0
Page 74
January 2011
Version 3.0
Page 75
January 2011
Version 3.0
Page 76
January 2011
Version 3.0
Page 77
January 2011
Version 3.0
Page 78
January 2011
Version 3.0
Page 79
January 2011
4.6
Version 3.0
Twit
Page 80
January 2011
Version 3.0
Page 81
January 2011
4.7
Version 3.0
Affiliation Twitter
4.7.2 To AffTwitter
fTwitter [This person received Tweets from ?]
This transform will find people that wrote Tweets TO the selected person.
Page 82
January 2011
Version 3.0
Page 83
January 2011
Version 3.0
Page 84
January 2011
Version 3.0
Page 85
January 2011
Version 3.0
Page 86
January 2011
Version 3.0
Page 87
January 2011
Version 3.0
Along with the standard entities there are various transforms that can be used and that come
preconfigured with Maltego. This section provides an overview of these standard transforms.
5.1
Infrastructure
1. ASNumberToNetblocks_Robtex. This transform shows which routes are located within an AS number by
looking it up on RobTex (www.robtex.com).
1. DNSNameToDomain_DNS. This transform extracts all the domains from a DNS Name - it excludes TLDs and
SLD.
2. DNSNameTOIPAddress_DNS. This transform resolves a DNS name to an IP address using plain old DNS.
3. DNSNameTOWebsite_QueryPorts. This transform determines if a DNS Name is a Web Site by checking for
responsive HTTP(s) ports. This version only checks port 80.
Page 88
January 2011
Version 3.0
1. DomainToMXrecord_DNS. This transform will find the MX records (mail servers) of a domain.
2. DomainToNSrecord_DNS. This transform will find the NS records (name servers) of a domain.
3. DomainToDNSName_ZT. This transform will attempt to perform a zone transfer a returns A and Cname
records - done via Serversniff (www.serversniff.de).
4. DomainToDNSName_DNSBrute. This transform will try to discover various common DNS Names in a
domain.
5. DomainToDNSName NameSchema. This transform will attempt to determine the naming schema of the
domain - e.g. Lords of the Rings, Planets, Trees etc.
6. DomainToDomain_TLD. This transform will try to find domains with different TLDs by looking it up at
ServerSniff (www.serversniff.de).
7. DomainToEmailAddress Whois. This transform obtains whois information of the IP number, then parses it
for email addresses.
8. DomainToEmailAddress PGP. This transform contacts a public PGP keyserver and retrieves email
addresses containing the given domain.
9. Search Engine. This transform searches for the domain and shows related email addresses.
10. Search Engine. This transform will search for email addresses containing the domain name.
1. DomainToEntities Whois NER. This transform obtains whois information of the domain then parses it for
entities using NER.
2. Search Engine. This transform will search for the locations of interesting files hosted on web sites inside the
domain.
3. Search Engine. This transform will search for the locations of interesting documents (think Office[tm])
hosted on web sites inside the domain.
4. DomainToPerson PGP. This transform contacts a public PGP key server and returns Person Entities with
email addresses that are located within the given domain.
5. Search Engine. This transform will search for the given domain and shows the related phone numbers.
6. DomainToPhone Whois. This transforms obtains whois information of the given domain, then parses it for
telephone numbers.
7. Search Engine. This transform will query a search engine for websites and return them as website entities.
Page 89
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
8. DomainToWebsite DNS. This transform will quickly see if there is a www.DOMAIN entry. Useful when used
in bulk.
9. Search Engine. This transform will search for the domain name and then show the web sites where the
domain name occurs.
Page 90
January 2011
Version 3.0
There are no transforms included by default that can be run on a location. Some transforms may however return a
location as a result.
1. MXrecordToDomain DNS. This transform extracts all the domains from a DNS Name - it excludes TLDs and
SLD.
2. MXrecordToDomain SharedMX. This transform determines which other domains uses the same DNS name
as MX record by looking it up on ServerSniff and RobTex.
3. MXrecordToIPAddress_DNS. This transform resolves a MX record to an IP address using plain old DNS.
Page 91
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
1. NSrecordToDomain DNS. This transform extracts all the domains from a DNS Name - it excludes TLDs and
SLD.
2. NSrecordToDomain SharedNS. NS record by looking it up on ServerSniff and RobTex. As byproduct you'll
also get netblocks for which this nameserver is primary server - where applicable.
3. NSrecordToIPAddress_DNS. This transform resolves a NS record to an IP address using plain old DNS .
4. NSrecordToNetblock_NS4block.This transform will contact Robtex and determine if the NS record has any
(reverse) DNS netblocks delegated to it.
5.1.8 Netblock
1. NetblockToAS SS. This transforms determines the AS number of the netblock by looking it up at ServerSniff .
2. NetblockToDNSName SS. This transform contacts ServerSniff and Robtex and asks it for DNS Names it found
in the given netblock.
3. NetblockToEntities NER Whois. This transform obtains whois information of netblock (well the first IP in
the block), then parses it for entities using NER.
4. NetblockToLocation SS.This transforms determines the country location of the netblock.
5.1.9 URL
1.
2.
3.
4.
5.
6.
URLToEmail Parse. This transform finds the email addresses on the URL.
URLToPerson NLP. This transform uses Natural Language Processing (NLP/NER) to extract entities.
URLToPhoneNumber Parse. This transform finds the phone numbers on the URL
URLToURL IncomingLinks. This transform finds the incoming URLs to an URL by looking on a search engine.
URLToWebsite Convert. This transform converts an URL to a website.
URLToWebsite Parse. This transform looks for outgoing links on the URL and show them as websites.
Page 92
January 2011
Version 3.0
5.1.10 Website
1. WebsiteToEmailAddress Mirror. This transform uses Gary's Ruby website mirror to spider the site and
extract email addresses.
2. WebsiteToWebsite Mirror. This transform uses Gary's Ruby website mirror to spider the site and extract
links.
3. WebsiteToDomain DNS. This transform extracts all the domains from a website - it excludes TLDs and SLD.
4. WebsiteToIPAddress DNS.This transform resolves a Website to an IP address using plain old DNS.
5. WebsiteToURL Expand. This transform just dumps the URLs collected from a search engine.
6. WebsiteToWebsite Incominglinks.This transform finds the incoming links to a website by looking for
incoming links on a search engine.
7. WebsiteToWebsite Thumb. This transform gets a thumbnail of the website using Thumbshot.org
8. WebsiteToWebTitle Mech. This transform will attempt to get the title of the website. It tries to follow all
redirects.
5.2
Personal
5.2.1 Document
1. DocumentToPersonEmail_Meta. This transform extracts the meta information from the document and then
parses it for username (persons) and/or email addresses.
2. DocumentToURL Dump. This transform just dumps the URL of the Document for further use.
Page 93
January 2011
Version 3.0
5.2.2 Email
1. EmailAddressToDomain DNS. This transform will remove the part in front of the @ sign of the given
address.
2. EmailAddressToEmailAddress SignedPGP. This transform contacts a public PGP keyserver and retrieves
the email addresses of signers for the given address.
3. EmailAddressToEmailAddress SamePGP. This transform contacts a public PGP keyserver and retrieves
alternative email addresses for the given address.
4. Search Engine. This transform will search for the email address and show related email addresses.
5. EmailAddressToPerson Same PGP. This transform contacts a public PGP keyserver and retrieves the
person's name for the given address.
6. Search Engine. This transform will search for the given email address and show the related telephone
numbers.
7. EmailAddressToAff Rapleaf. (Removed).
8. EmailAddressToURL Expand. This transform just dumps the URLs collected from the search engine.
9. Search Engine. This transform will search for the email address and shows the sites where it occurs.
10. EmailAddressToEmailAddress Verify. This transform simply connects to the relevant mail server and
checks to see if the email address exists. The results are passed back in the same entity - as a label.
5.2.3 Person
Page 94
January 2011
Maltego 3 User Guide - Transforms
Version 3.0
4. Search Engine. This transform searches for the person's most likely email address.
5. PersonToPerson PGP. This transform contacts a public PGP keyserver and returns the names of people that
signed the given person's key.
6. Search Engine. This transform searches for the person's associated telephone numbers.
7. Search Engine. This transform shows sites where various permutations of the person's name was found.
1.
2.
3.
4.
Search Engine. This transform searches for the telephone number and returns related email addresses.
Search Engine. This transform searches for the telephone number and returns related phone numbers.
PhoneNumberToURL Expand. This transform just dumps the URLs collected from the search engine.
Search Engine. This transform searches for the telephone number and returns related sites.
5.2.5 Phrase
1. Search Engine. This transform will search for the phrase and show related email addresses.
2. PhraseToPhrase OpenCalais. Looking for entities in the actual document.
3. Search Engine. This transform will search for the given phrase and show interesting files containing the
term.
4. Search Engine. This transform will search for the given phrase and show documents (Office[tm]) containing
the term.
5. (Removed).
6. Search Engine. This transform will search for the phrase and shows the related telelphone numbers.
7. PhraseToTwit Search. This transform will search Twitter for a phrase and shows relevant entries.
8. Search Engine. This transform will search for the given phrase and show the sites where the phrase occurs.
9. PhraseToPhrase RT. Looking for key phrases.
Page 95
January 2011
Version 3.0
5.2.6 Twit
1. TwitToPerson Parse. This transform will convert a Twit to a Twitter Affiliation entity by simply converting
it.
2. TwitToURL Expand. TThis transform will try to mine URL from Tweets, also expanding the tiny URLs.
There are no transforms included by default that can be run on Affiliation - Facebook. Some transforms may
however return an Affiliation - Facebook as a result.
There are no transforms included by default that can be run on Affiliation - LinkedIn. Some transforms may
however return an Affiliation - LinkedIn as a result.
Page 96
January 2011
Version 3.0
1. AffTwitterToAffTwitter GetDetail. This transform will find detail about the Twitter entity.
2. AffTwitterToAffTwitter RecFrom. This transform will find people that wrote Tweets TO the selected
person.
3. AffTwitterToAffTwitter WritesTo. This transform people that the selected person wrote Tweets TO.
4. AffTwitterToPerson. This transform will convert the Affiliation to a person, with the alias in the
'addditional' field.
5. AffTwitterToTwit Sameperson. This transform will find more Twitter posts from the same user.
6. AffTwitterToTwit OtherAuthors. This transform will find Tweets to other people from the selected author.
7. AffTwitterToAffTwitter Followers. This transform will find followers of the selected person.
8. AffTwitterToAffTwitter Friends. This transform will find friends of the selected person.
Page 97