StringTokenizer in Java
The java.util.StringTokenizer class allows you to break a String into tokens. It is simple
way to break a String.
It doesn't provide the facility to differentiate numbers, quoted strings, identifiers etc.
In the StringTokenizer class, the delimiters can be provided at the time of creation or one
by one to the tokens.
Constructor Description
StringTokenizer(String str) It creates StringTokenizer with specified string.
StringTokenizer(String str, String delim) It creates StringTokenizer with specified string and delimiter.
It creates StringTokenizer with specified string, delimiter and
return Value. If returnvalue is true, delimiter characters are
StringTokenizer(String str, String delim,
considered to be tokens. If it is false, delimiter
boolean returnValue)
Characters serve to separate tokens.
Methods of the StringTokenizer Class
The six useful methods of the StringTokenizer class are as follows:
Methods Description
boolean hasMoreTokens() It checks if there is more tokens available.
It returns the next token from the StringTokenizer
String nextToken()
object.
String nextToken(String delim) It returns the next token based on the delimiter.
boolean hasMoreElements() It is the same as hasMoreTokens() method.
It is the same as nextToken() but its return type is
Object nextElement()
Object.
int countTokens() It returns the total number of tokens.
Example of StringTokenizer Class
Let's see an example of the StringTokenizer class that tokenizes a string "my name is
khan" on the basis of whitespace.
Example 1
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my name is khan"," ");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken());
}
}
}
OUTPUT
my
name
is
khan
Example 2
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my name is khan");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken());
}
}
}
OUTPUT
java -cp /tmp/cLPe24x1uX/Simple
my
name
is
khan
Example 3
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my name is khan");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken(" "));
Output
java -cp /tmp/ov7pOmjS2f/Simple
my
name
is
khan
Example 4
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my name is khan","/");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken(" "));
Output
java -cp /tmp/rALr7kwTay/Simple
my
name
is
khan
Example 5
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my/name/is/khan","/");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken(" "));
}
OUTPUT
java -cp /tmp/wAGucBDOtZ/Simple
my/name/is/khan
Example 6
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my/name/is/khan","/");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken());
Output
java -cp /tmp/8UwQchViea/Simple
my
name
is
khan
Example 7
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my/name/is/khan","/");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken("/"));
}
Output
java -cp /tmp/zpmX3vr5AW/Simple
my
name
is
khan
Example 8
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my/name/is/khan","/");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken());
Output
java -cp /tmp/OmzpcZFQUN/Simple
my
name
is
khan
Example 9
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my/name/is/khan");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken());
Output
java -cp /tmp/YsIlKQvR7K/Simple
my/name/is/khan
Example 10
import java.util.StringTokenizer;
public class Simple{
public static void main(String args[]){
StringTokenizer st = new StringTokenizer("my name is khan");
while (st.hasMoreTokens()) {
System.out.println(st.nextToken());
OUTPUT
java -cp /tmp/WQfW7XojTD/Simple
my
name
is
khan
All the above Java codes, demonstrates the use of StringTokenizer class and its
methods hasMoreTokens() and nextToken().
Example 10
Here we do not use loop
import java.util.*;
public class Test {
public static void main(String[] args) {
StringTokenizer st = new StringTokenizer("my,name,is,khan");
// printing next token
System.out.println("Next token is : " + st.nextToken(","));
}
}
Output
java -cp /tmp/i9jHCZRZtA/Test
Next token is : my
Example 11
import java.util.*;
public class Test {
public static void main(String[] args) {
StringTokenizer st = new StringTokenizer("my/name/is/khan");
// printing next token
System.out.println("Next token is : " + st.nextToken(","));
}
}
Output
java -cp /tmp/etqOqQN28n/Test
Next token is : my/name/is/khan
Example 12
import java.util.*;
public class Test {
public static void main(String[] args) {
StringTokenizer st = new StringTokenizer("my/name/is/khan");
// printing next token
System.out.println("Next token is : " + st.nextToken("/"));
}
}
output
java -cp /tmp/dkTdHzN6M8/Test
Next token is : my
Example of hasMoreTokens() method of the StringTokenizer
class
This method returns true if more tokens are available in the tokenizer String otherwise
returns false.
import java.util.StringTokenizer;
public class StringTokenizer1
/* Driver Code */
public static void main(String args[])
/* StringTokenizer object */
StringTokenizer st = new StringTokenizer("Demonstrating methods from StringTokenizer
class"," ");
/* Checks if the String has any more tokens */
while (st.hasMoreTokens())
System.out.println(st.nextToken());
Output
java -cp /tmp/YbWIyMhLWm/StringTokenizer1
Demonstrating
methods
from
StringTokenizer
Class
Example of hasMoreElements() method of the StringTokenizer
class
Example1
import java.util.StringTokenizer;
public class StringTokenizer2
{
public static void main(String args[])
{
StringTokenizer st = new StringTokenizer("Hello everyone I am a Java developer",
" ");
while (st.hasMoreElements())
{
System.out.println(st.nextToken());
}
}
}
Output
java -cp /tmp/5FCrut1ewC/StringTokenizer2
Hello
everyone
am
Java
Developer
Example 2
import java.util.StringTokenizer;
public class StringTokenizer2
public static void main(String args[])
{
StringTokenizer st = new StringTokenizer("Hello everyone I am a Java developer");
while (st.hasMoreElements())
System.out.println(st.nextToken());
Output
java -cp /tmp/rmrQ7eNMlv/StringTokenizer2
Hello
everyone
am
Java
developer
Example of nextElement() method of the StringTokenizer class
nextElement() returns the next token object in the tokenizer String.
Example 1
import java.util.StringTokenizer;
public class StringTokenizer3
{
/* Driver Code */
public static void main(String args[])
{
/* StringTokenizer object */
StringTokenizer st = new StringTokenizer("Hello Everyone Have a nice day"," ");
/* Checks if the String has any more tokens */
while (st.hasMoreTokens())
{
/* Prints the elements from the String */
System.out.println(st.nextElement());
}
}
}
Output
java -cp /tmp/Gkjr52nO80/StringTokenizer3
Hello
Everyone
Have
nice
day
Example 2
import java.util.StringTokenizer;
public class StringTokenizer3
/* Driver Code */
public static void main(String args[])
/* StringTokenizer object */
StringTokenizer st = new StringTokenizer("Hello Everyone Have a nice day");
/* Checks if the String has any more tokens */
while (st.hasMoreTokens())
/* Prints the elements from the String */
System.out.println(st.nextElement());
}
Output
java -cp /tmp/SmzwJ7yJav/StringTokenizer3
Hello
Everyone
Have
nice
day
Example 3
import java.util.StringTokenizer;
public class StringTokenizer3
/* Driver Code */
public static void main(String args[])
/* StringTokenizer object */
StringTokenizer st = new StringTokenizer("Hello,Everyone,Have,a,nice,day");
/* Checks if the String has any more tokens */
while (st.hasMoreTokens())
/* Prints the elements from the String */
System.out.println(st.nextElement());
Output
java -cp /tmp/zHJbukdqrt/StringTokenizer3
Hello,Everyone,Have,a,nice,day
Example 4
import java.util.StringTokenizer;
public class StringTokenizer3
/* Driver Code */
public static void main(String args[])
/* StringTokenizer object */
StringTokenizer st = new StringTokenizer("Hello,Everyone,Have,a,nice,day",",");
/* Checks if the String has any more tokens */
while (st.hasMoreTokens())
/* Prints the elements from the String */
System.out.println(st.nextElement());
Output
java -cp /tmp/LIJ72PyKGz/StringTokenizer3
Hello
Everyone
Have
nice
day
Examples of Java String Tokenizer Constructors
// Java Program to implement
// Java String Tokenizer Constructors
import java.util.*;
// Driver Class
class GFG {
// main function
public static void main(String[] args)
{
// Constructor 1
System.out.println("Using Constructor 1 - ");
// Creating object of class inside main() method
StringTokenizer st1 = new StringTokenizer(
"Hello Geeks How are you", " ");
// Condition holds true till there is single token
// remaining using hasMoreTokens() method
while (st1.hasMoreTokens())
// Getting next tokens
System.out.println(st1.nextToken());
// Constructor 2
System.out.println("Using Constructor 2 - ");
// Again creating object of class inside main()
// method
StringTokenizer st2 = new StringTokenizer(
"JAVA : Code : String", " :");
// If tokens are present
while (st2.hasMoreTokens())
// Print all tokens
System.out.println(st2.nextToken());
// Constructor 3
System.out.println("Using Constructor 3 - ");
// Again creating object of class inside main()
// method
StringTokenizer st3 = new StringTokenizer(
"JAVA : Code : String", " :", true);
while (st3.hasMoreTokens())
System.out.println(st3.nextToken());
}
}
OUTPUT
java -cp /tmp/TUVhwyKJYi/GFG
Using Constructor 1 -
Hello
Geeks
How
are
you
Using Constructor 2 -
JAVA
Code
String
Using Constructor 3 -
JAVA
Code
String
Example of Methods of StringTokenizer Class
// Java Program to implement
//
import java.util.*;
// Driver Class
class GFG {
// main function
public static void main(String[] args)
{
// Creating a StringTokenizer
StringTokenizer str = new StringTokenizer(
"Welcome to GeeksforGeeks");
StringTokenizer temp = new StringTokenizer("");
// countTokens Method
int count = str.countTokens();
System.out.println(count);
// hasMoreTokens Methods
System.out.println("Welcome to GeeksforGeeks:
"+str.hasMoreTokens());
System.out.println("(Empty String) : "+temp.hasMoreTokens());
// nextElement() Method
System.out.println("\nTraversing the String:");
while(str.hasMoreTokens()){
System.out.println(str.nextElement());
}
}
}
OUTPUT
java -cp /tmp/kwcHxwTWe6/GFG
Welcome to GeeksforGeeks: true
(Empty String) : false
Traversing the String:
Welcome
to
GeeksforGeeks
Example of countTokens() method of the StringTokenizer class
This method calculates the number of tokens present in the tokenizer String.
import java.util.StringTokenizer;
public class StringTokenizer3
{
/* Driver Code */
public static void main(String args[])
{
/* StringTokenizer object */
StringTokenizer st = new StringTokenizer("Hello Everyone Have a nice day"," ");
/* Prints the number of tokens present in the String */
System.out.println("Total number of Tokens: "+st.countTokens());
}
Output
java -cp /tmp/PXORL5vnNg/StringTokenizer3
Total number of Tokens: 6
Write a program to accept a sentence which may be
terminated by either '.', '?' or '!' only. The words may be
separated by more than one blank space and are in UPPER
CASE.
Perform the following tasks:
1. Find the number of words beginning and ending with a vowel.
2. Place the words which begin and end with a vowel at the beginning,
followed by the remaining words as they occur in the sentence.
Test your program with the sample data and some random
data:
Example 1
INPUT:
ANAMIKA AND SUSAN ARE NEVER GOING TO QUARREL
ANYMORE.
OUTPUT:
NUMBER OF WORDS BEGINNING AND ENDING WITH A VOWEL
=3
ANAMIKA ARE ANYMORE AND SUSAN NEVER GOING TO
QUARREL
Example 2
INPUT:
YOU MUST AIM TO BE A BETTER PERSON TOMORROW THAN
YOU ARE TODAY.
OUTPUT:
NUMBER OF WORDS BEGINNING AND ENDING WITH A VOWEL
=2
A ARE YOU MUST AIM TO BE BETTER PERSON TOMORROW
THAN YOU TODAY
Example 3
INPUT:
LOOK BEFORE YOU LEAP.
OUTPUT:
NUMBER OF WORDS BEGINNING AND ENDING WITH A VOWEL
=0
LOOK BEFORE YOU LEAP
Example 4
INPUT:
HOW ARE YOU@
OUTPUT:
INVALID INPUT
Ans:- import java.util.*;
public class VowelWord
public static void main(String args[]) {
Scanner in = new Scanner(System.in);
System.out.println("ENTER THE SENTENCE:");
String ipStr = in.nextLine().trim().toUpperCase();
int len = ipStr.length();
char lastChar = ipStr.charAt(len - 1);
if (lastChar != '.'
&& lastChar != '?'
&& lastChar != '!') {
System.out.println("INVALID INPUT");
return;
String str = ipStr.substring(0, len - 1);
StringTokenizer st = new StringTokenizer(str);
StringBuffer sbVowel = new StringBuffer();
StringBuffer sb = new StringBuffer();
int c = 0;
while (st.hasMoreTokens()) {
String word = st.nextToken();
int wordLen = word.length();
if (isVowel(word.charAt(0))
&& isVowel(word.charAt(wordLen - 1))) {
c++;
sbVowel.append(word);
sbVowel.append(" ");
else {
sb.append(word);
sb.append(" ");
String newStr = sbVowel.toString() + sb.toString();
System.out.println("NUMBER OF WORDS BEGINNING AND ENDING WITH A
VOWEL = " + c);
System.out.println(newStr);
public static boolean isVowel(char ch) {
ch = Character.toUpperCase(ch);
boolean ret = false;
if (ch == 'A'
|| ch == 'E'
|| ch == 'I'
|| ch == 'O'
|| ch == 'U')
ret = true;
return ret;
Output
ENTER THE SENTENCE:
my name is anamika i ama
INVALID INPUT
ENTER THE SENTENCE:
anamika anaya asa is a student.
NUMBER OF WORDS BEGINNING AND ENDING WITH A VOWEL = 4
ANAMIKA ANAYA ASA A IS STUDENT
