libboost-tokenizer

[full]

Break of a string or other character sequence into a series of tokens

Boost.Tokenizer is a part of Boost C++ Libraries. The Boost.Tokenizer package provides a flexible and easy-to-use way to break a string or other character sequence into a series of tokens.

License

Distributed under the Boost Software License, Version 1.0.

Properties

Build Status

Branch Travis Appveyor Coverity Scan codecov.io Deps Docs Tests
master Build Status Build status Coverity Scan Build Status codecov Deps Documentation Enter the Matrix
develop Build Status Build status Coverity Scan Build Status codecov Deps Documentation Enter the Matrix

Overview

break up a phrase into words.

Try it online

#include <iostream>
#include <boost/tokenizer.hpp>
#include <string>

int main(){
    std::string s = "This is,  a test";
    typedef boost::tokenizer<> Tok;
    Tok tok(s);
    for (Tok::iterator beg = tok.begin(); beg != tok.end(); ++beg){
        std::cout << *beg << "\n";
    }
}

... More
license BSL-1.0
project boost
url github.com/boostorg/tokenizer
doc-url www.boost.org/doc/libs/1_78_0/libs/tokenizer
topics C++Boost
2 Versions
version 1.78.0
repository https://pkg.cppget.org/1/stable
depends 6; libboost-assert, libboost-config, libboost-iterator, libboost-mpl, libboost-throw-exception, libboost-type-traits
version 1.77.0+1
repository https://pkg.cppget.org/1/stable
depends 6; libboost-assert, libboost-config, libboost-iterator, libboost-mpl, libboost-throw-exception, libboost-type-traits