Package net.sourceforge.pmd.cpd

Class CPPTokenizer

java.lang.Object

net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

net.sourceforge.pmd.cpd.CPPTokenizer

All Implemented Interfaces:

Tokenizer

public class CPPTokenizer
extends net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

The C++ tokenizer.

Field Summary

Fields inherited from interface net.sourceforge.pmd.cpd.Tokenizer

DEFAULT_SKIP_BLOCKS_PATTERN, IGNORE_ANNOTATIONS, IGNORE_IDENTIFIERS, IGNORE_LITERALS, IGNORE_USINGS, OPTION_IGNORE_LITERAL_SEQUENCES, OPTION_SKIP_BLOCKS, OPTION_SKIP_BLOCKS_PATTERN

Constructor Summary

Constructors

Constructor	Description
CPPTokenizer()

Method Summary

Modifier and Type	Method	Description
protected TokenFilter<JavaccToken>	getTokenFilter(TokenManager<JavaccToken> tokenManager)
protected TokenManager<JavaccToken>	makeLexerImpl(CharStream sourceCode)
void	setProperties(Properties properties)	Sets the possible options for the C++ tokenizer.
protected JavaccTokenDocument.TokenDocumentBehavior	tokenBehavior()

Methods inherited from class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

getImage, getLexerForSource, processToken, tokenize

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

CPPTokenizer

public CPPTokenizer()

Method Detail

setProperties

public void setProperties(Properties properties)

Sets the possible options for the C++ tokenizer.

Parameters:

properties - the properties

See Also:

Tokenizer.OPTION_SKIP_BLOCKS, Tokenizer.OPTION_SKIP_BLOCKS_PATTERN, Tokenizer.OPTION_IGNORE_LITERAL_SEQUENCES

tokenBehavior

protected JavaccTokenDocument.TokenDocumentBehavior tokenBehavior()

Overrides:

tokenBehavior in class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

makeLexerImpl

protected TokenManager<JavaccToken> makeLexerImpl(CharStream sourceCode)

Specified by:

makeLexerImpl in class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer

getTokenFilter

protected TokenFilter<JavaccToken> getTokenFilter(TokenManager<JavaccToken> tokenManager)

Overrides:

getTokenFilter in class net.sourceforge.pmd.cpd.internal.JavaCCTokenizer