2018-04-07 20:16:55 +00:00
|
|
|
#include "utils/string.hpp"
|
config_parser: Introduce stricter syntax conventions (#1377)
This is the next step to merge #1237 in stages.
Currently there are barely any restrictions on how the config can be
written. This causes things like config files with DOS line endings to
not be parsed properly (#1366) because polybar splits by `\n` and when
parsing section headers, it can't deal with the `\r` at the end of the
line and thus doesn't recognize any section headers.
With this PR we introduce some rules as to what characters are allowed
in section names and keys.
Note: When talking about spaces I refer to any character for which
`isspace()` returns `true`.
The rules are as follows:
* A section name or a key name cannot contain any spaces as well as any
of there characters:`"'=;#[](){}:.$\%`
* Spaces at the beginning and end of lines are always ignored when
parsing
* Comment lines start with `;` or `#` and last for the whole line. The
whole line will be ignored by the parser. You cannot start a comment at
the end of a line.
* Section headers have the following form `[HEADER_NAME]`
* Key-value lines look like this:
`KEY_NAME{SPACES}={SPACES}VALUE_STRING` where `{SPACES}` represents any
number of spaces. `VALUE_STRING` can contain any characters. If it is
*surrounded* with double quotes (`"`), those quotes will be removed,
this can be used to add spaces to the beginning or end of the value
* Empty lines are lines with only spaces in them
* If the line has any other form, it is a syntax error
This will introduce the following breaking changes because of how
underdefined the config syntax was before:
* `key = ""` will get treated as an empty string instead of the literal
* string `""`
* Any section or key name with forbidden characters will now be syntax
errors.
* Certain strings will be forbidden as section names: `self`, `root`,
* `BAR`. Because they have a special meaning inside references and so a
* section `[root]` can never be referenced.
This replaces the current parser implementation with a new more robust
one that will later be expanded to also check for dependency cycles and
allow for values that contain references mixed with other strings.
This PR also now expands the config paths given over the command line so
that `--config=~/.config/polybar/config` resolves properly.
Closes #1032
Closes #1694
* config_parser: Add skeleton with tests
First step in the config_parser develoment. Only tests functions that
are easily testable without many outside dependencies. Integration tests
will follow.
* config_parser: Implement parse_header
* config_parser: Implement get_line_type
* feat(string): Add trim functions with predicate
Not only trimming based on single character matching but based on a
freely specifiable predicate. Will be used to trim all spaces (based on
isspace)
* config_parser: Implement parse_key
* config_parser: Implement parse_line for valid lines
* config_parser: Throw exception on invalid lines
* config_parser: Remove line_no and file_index from parse_line
Cleaner to let the caller catch and fill in the line number and file
path
* string: Clear up misleading description of trim
Before, trim would remove all characters that *didn't* match the
predicate and thus the predicate isspace wouldn't work correctly. But
because we used the inverse (isnospace_pred) it all worked out, but if
the function was used with any other function, it wouldn't have given
the desired output
* config_parser: Implement parse_file
* config_parser: Switch operation to config_parser
This changes the way the config is invoked. Now main.cpp creates a
config_parser object which then returns the singleton config object from
the parse method. Subsequent calls to config::make will return the
already created config object as before
The config_parser does not yet have all the functionality of the old
parser: `inherit` directives are not yet resolved. Other than that all
the old functionality is implemented (creating sectionmap and applying
include-file)
Any sort of dependency detection (except for include-file) are still
missing
* config: Move xrm initialization to constructor
config_parser handles the detection of xrdb references and passes that
info to the config object.
This finally allows us to delete the config::parse_file function because
everything in it has been implemented (except for xrdb detection and
file error handling)
* refactor(config_parser): Cleanup
* config_parser: Set config data after initialization
Looks much cleaner this way
* config_parser: Expand include-file paths
* config_parser: Init xrm if the config uses %{xrdb references
* config_parser: Use same type of maps as in old impl
Polybar has some weird, not yet fixed, inheriting behaviour and it
changes depending on the order in which the config stores its data.
Using the same type of maps ensures that the behaviour stays the same.
* refactor(config_parser): Clearer invalid name error message
* config_parser: Don't allow reserved section names
Sections with the names 'self', 'BAR', 'root' could never be referenced
because those strings have a special meaning inside references
* config_parser: Handle inherit directives
This uses the old copy_inherited function, so this still suffers from
crashes if there are cyclic dependencies.
This also fixes the behaviour where any key that starts with 'inherit'
would be treated as an inherit directive
* config_parser: Clearer dependency cycle error message
* refactor(config_parser): Handle file errors when parsing
This removes the need to check if the file exists separately
* fix(config): expand config file path
Now paths using ~ and environment variables can be used as the config
path
* fix(config): Properly recognize xrdb references
* config_parser: Make messages more informative
* doc(config): Improve commenting
Comments now describe what the config_parser actually does instead of
what it will do.
We also now follow the rule that single line comments inside functions
should use `//` comments
* refactor: Move else on same line as curly braces
* fix(config_parser): Don't duplicate paths in `files`
* refactor(config_parser): Use else if for clarity
* fix(config): Undefined behavior in syntax_error
Before the custom what() method produced undefined behavior because the
returned string became invalid once the function returned.
* refactor(config): descriptive name for useless lines
is_valid could easily be confused as meaning syntactically invalid
without it being clarified in a comment
* refactor(config): Use separate strings instead of key_value
Takes just as much space and is much better to read
* fix(config_parser): TestCase -> TestSuite and fix macro call
Ref: #1644
* config_parser: use const string& in method args
* config_parser: Improve comments
* config_parser: Incorporate review comments
2019-08-06 17:41:31 +00:00
|
|
|
#include "common/test.hpp"
|
2016-10-24 23:47:00 +00:00
|
|
|
|
2018-05-21 13:10:24 +00:00
|
|
|
using namespace polybar;
|
|
|
|
|
|
|
|
TEST(String, upper) {
|
|
|
|
EXPECT_EQ("FOO", string_util::upper("FOO"));
|
|
|
|
EXPECT_EQ("FOO", string_util::upper("FoO"));
|
|
|
|
EXPECT_EQ("FOO", string_util::upper("FOo"));
|
|
|
|
EXPECT_EQ("FOO", string_util::upper("Foo"));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, lower) {
|
|
|
|
EXPECT_EQ("bar", string_util::lower("BAR"));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, compare) {
|
|
|
|
EXPECT_TRUE(string_util::compare("foo", "foo"));
|
|
|
|
EXPECT_TRUE(string_util::compare("foo", "Foo"));
|
|
|
|
EXPECT_FALSE(string_util::compare("foo", "bar"));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, replace) {
|
|
|
|
EXPECT_EQ("a.c", string_util::replace("abc", "b", "."));
|
|
|
|
EXPECT_EQ("a.a", string_util::replace("aaa", "a", ".", 1, 2));
|
|
|
|
EXPECT_EQ(".aa", string_util::replace("aaa", "a", ".", 0, 2));
|
|
|
|
EXPECT_EQ("Foo bxr baz", string_util::replace("Foo bar baz", "a", "x"));
|
|
|
|
EXPECT_EQ("foxoobar", string_util::replace("foooobar", "o", "x", 2, 3));
|
|
|
|
EXPECT_EQ("foooobar", string_util::replace("foooobar", "o", "x", 0, 1));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, replaceAll) {
|
|
|
|
EXPECT_EQ("Foo bxr bxzx", string_util::replace_all("Foo bar baza", "a", "x"));
|
|
|
|
EXPECT_EQ("hoohoohoo", string_util::replace_all("hehehe", "he", "hoo"));
|
|
|
|
EXPECT_EQ("hoohehe", string_util::replace_all("hehehe", "he", "hoo", 0, 2));
|
|
|
|
EXPECT_EQ("hehehoo", string_util::replace_all("hehehe", "he", "hoo", 4));
|
|
|
|
EXPECT_EQ("hehehe", string_util::replace_all("hehehe", "he", "hoo", 0, 1));
|
|
|
|
EXPECT_EQ("113113113", string_util::replace_all("131313", "3", "13"));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, squeeze) {
|
|
|
|
EXPECT_EQ("Squeze", string_util::squeeze("Squeeeeeze", 'e'));
|
|
|
|
EXPECT_EQ("bar baz foobar", string_util::squeeze("bar baz foobar", ' '));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, strip) {
|
|
|
|
EXPECT_EQ("Strp", string_util::strip("Striip", 'i'));
|
|
|
|
EXPECT_EQ("test\n", string_util::strip_trailing_newline("test\n\n"));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, trim) {
|
|
|
|
EXPECT_EQ("x x", string_util::trim(" x x "));
|
|
|
|
EXPECT_EQ("testxx", string_util::ltrim("xxtestxx", 'x'));
|
|
|
|
EXPECT_EQ("xxtest", string_util::rtrim("xxtestxx", 'x'));
|
|
|
|
EXPECT_EQ("test", string_util::trim("xxtestxx", 'x'));
|
|
|
|
}
|
|
|
|
|
config_parser: Introduce stricter syntax conventions (#1377)
This is the next step to merge #1237 in stages.
Currently there are barely any restrictions on how the config can be
written. This causes things like config files with DOS line endings to
not be parsed properly (#1366) because polybar splits by `\n` and when
parsing section headers, it can't deal with the `\r` at the end of the
line and thus doesn't recognize any section headers.
With this PR we introduce some rules as to what characters are allowed
in section names and keys.
Note: When talking about spaces I refer to any character for which
`isspace()` returns `true`.
The rules are as follows:
* A section name or a key name cannot contain any spaces as well as any
of there characters:`"'=;#[](){}:.$\%`
* Spaces at the beginning and end of lines are always ignored when
parsing
* Comment lines start with `;` or `#` and last for the whole line. The
whole line will be ignored by the parser. You cannot start a comment at
the end of a line.
* Section headers have the following form `[HEADER_NAME]`
* Key-value lines look like this:
`KEY_NAME{SPACES}={SPACES}VALUE_STRING` where `{SPACES}` represents any
number of spaces. `VALUE_STRING` can contain any characters. If it is
*surrounded* with double quotes (`"`), those quotes will be removed,
this can be used to add spaces to the beginning or end of the value
* Empty lines are lines with only spaces in them
* If the line has any other form, it is a syntax error
This will introduce the following breaking changes because of how
underdefined the config syntax was before:
* `key = ""` will get treated as an empty string instead of the literal
* string `""`
* Any section or key name with forbidden characters will now be syntax
errors.
* Certain strings will be forbidden as section names: `self`, `root`,
* `BAR`. Because they have a special meaning inside references and so a
* section `[root]` can never be referenced.
This replaces the current parser implementation with a new more robust
one that will later be expanded to also check for dependency cycles and
allow for values that contain references mixed with other strings.
This PR also now expands the config paths given over the command line so
that `--config=~/.config/polybar/config` resolves properly.
Closes #1032
Closes #1694
* config_parser: Add skeleton with tests
First step in the config_parser develoment. Only tests functions that
are easily testable without many outside dependencies. Integration tests
will follow.
* config_parser: Implement parse_header
* config_parser: Implement get_line_type
* feat(string): Add trim functions with predicate
Not only trimming based on single character matching but based on a
freely specifiable predicate. Will be used to trim all spaces (based on
isspace)
* config_parser: Implement parse_key
* config_parser: Implement parse_line for valid lines
* config_parser: Throw exception on invalid lines
* config_parser: Remove line_no and file_index from parse_line
Cleaner to let the caller catch and fill in the line number and file
path
* string: Clear up misleading description of trim
Before, trim would remove all characters that *didn't* match the
predicate and thus the predicate isspace wouldn't work correctly. But
because we used the inverse (isnospace_pred) it all worked out, but if
the function was used with any other function, it wouldn't have given
the desired output
* config_parser: Implement parse_file
* config_parser: Switch operation to config_parser
This changes the way the config is invoked. Now main.cpp creates a
config_parser object which then returns the singleton config object from
the parse method. Subsequent calls to config::make will return the
already created config object as before
The config_parser does not yet have all the functionality of the old
parser: `inherit` directives are not yet resolved. Other than that all
the old functionality is implemented (creating sectionmap and applying
include-file)
Any sort of dependency detection (except for include-file) are still
missing
* config: Move xrm initialization to constructor
config_parser handles the detection of xrdb references and passes that
info to the config object.
This finally allows us to delete the config::parse_file function because
everything in it has been implemented (except for xrdb detection and
file error handling)
* refactor(config_parser): Cleanup
* config_parser: Set config data after initialization
Looks much cleaner this way
* config_parser: Expand include-file paths
* config_parser: Init xrm if the config uses %{xrdb references
* config_parser: Use same type of maps as in old impl
Polybar has some weird, not yet fixed, inheriting behaviour and it
changes depending on the order in which the config stores its data.
Using the same type of maps ensures that the behaviour stays the same.
* refactor(config_parser): Clearer invalid name error message
* config_parser: Don't allow reserved section names
Sections with the names 'self', 'BAR', 'root' could never be referenced
because those strings have a special meaning inside references
* config_parser: Handle inherit directives
This uses the old copy_inherited function, so this still suffers from
crashes if there are cyclic dependencies.
This also fixes the behaviour where any key that starts with 'inherit'
would be treated as an inherit directive
* config_parser: Clearer dependency cycle error message
* refactor(config_parser): Handle file errors when parsing
This removes the need to check if the file exists separately
* fix(config): expand config file path
Now paths using ~ and environment variables can be used as the config
path
* fix(config): Properly recognize xrdb references
* config_parser: Make messages more informative
* doc(config): Improve commenting
Comments now describe what the config_parser actually does instead of
what it will do.
We also now follow the rule that single line comments inside functions
should use `//` comments
* refactor: Move else on same line as curly braces
* fix(config_parser): Don't duplicate paths in `files`
* refactor(config_parser): Use else if for clarity
* fix(config): Undefined behavior in syntax_error
Before the custom what() method produced undefined behavior because the
returned string became invalid once the function returned.
* refactor(config): descriptive name for useless lines
is_valid could easily be confused as meaning syntactically invalid
without it being clarified in a comment
* refactor(config): Use separate strings instead of key_value
Takes just as much space and is much better to read
* fix(config_parser): TestCase -> TestSuite and fix macro call
Ref: #1644
* config_parser: use const string& in method args
* config_parser: Improve comments
* config_parser: Incorporate review comments
2019-08-06 17:41:31 +00:00
|
|
|
TEST(String, trimPredicate) {
|
|
|
|
EXPECT_EQ("x\t x", string_util::trim("\t x\t x ", isspace));
|
|
|
|
EXPECT_EQ("x\t x", string_util::trim("x\t x ", isspace));
|
|
|
|
}
|
|
|
|
|
2018-05-21 13:10:24 +00:00
|
|
|
TEST(String, join) {
|
|
|
|
EXPECT_EQ("A, B, C", string_util::join({"A", "B", "C"}, ", "));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, splitInto) {
|
|
|
|
vector<string> strings;
|
|
|
|
string_util::split_into("A,B,C", ',', strings);
|
|
|
|
EXPECT_EQ(3, strings.size());
|
|
|
|
EXPECT_EQ("A", strings[0]);
|
|
|
|
EXPECT_EQ("C", strings[2]);
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, split) {
|
|
|
|
vector<string> strings{"foo", "bar"};
|
|
|
|
vector<string> result{string_util::split("foo,bar", ',')};
|
|
|
|
EXPECT_EQ(strings.size(), result.size());
|
|
|
|
EXPECT_EQ(strings[0], result[0]);
|
|
|
|
EXPECT_EQ("bar", result[1]);
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, findNth) {
|
|
|
|
EXPECT_EQ(0, string_util::find_nth("foobarfoobar", 0, "f", 1));
|
|
|
|
EXPECT_EQ(6, string_util::find_nth("foobarfoobar", 0, "f", 2));
|
|
|
|
EXPECT_EQ(7, string_util::find_nth("foobarfoobar", 0, "o", 3));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, hash) {
|
|
|
|
unsigned long hashA1{string_util::hash("foo")};
|
|
|
|
unsigned long hashA2{string_util::hash("foo")};
|
|
|
|
unsigned long hashB1{string_util::hash("Foo")};
|
|
|
|
unsigned long hashB2{string_util::hash("Bar")};
|
|
|
|
EXPECT_EQ(hashA2, hashA1);
|
|
|
|
EXPECT_NE(hashB1, hashA1);
|
|
|
|
EXPECT_NE(hashB2, hashA1);
|
|
|
|
EXPECT_NE(hashB2, hashB1);
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, floatingPoint) {
|
|
|
|
EXPECT_EQ("1.26", string_util::floating_point(1.2599, 2));
|
|
|
|
EXPECT_EQ("2", string_util::floating_point(1.7, 0));
|
|
|
|
EXPECT_EQ("1.7770000000", string_util::floating_point(1.777, 10));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, filesize) {
|
|
|
|
EXPECT_EQ("3.000 MB", string_util::filesize_mb(3 * 1024, 3));
|
|
|
|
EXPECT_EQ("3.195 MB", string_util::filesize_mb(3 * 1024 + 200, 3));
|
|
|
|
EXPECT_EQ("3 MB", string_util::filesize_mb(3 * 1024 + 400));
|
|
|
|
EXPECT_EQ("4 MB", string_util::filesize_mb(3 * 1024 + 800));
|
|
|
|
EXPECT_EQ("3.195 GB", string_util::filesize_gb(3 * 1024 * 1024 + 200 * 1024, 3));
|
|
|
|
EXPECT_EQ("3 GB", string_util::filesize_gb(3 * 1024 * 1024 + 400 * 1024));
|
|
|
|
EXPECT_EQ("4 GB", string_util::filesize_gb(3 * 1024 * 1024 + 800 * 1024));
|
|
|
|
EXPECT_EQ("3 B", string_util::filesize(3));
|
|
|
|
EXPECT_EQ("3 KB", string_util::filesize(3 * 1024));
|
|
|
|
EXPECT_EQ("3 MB", string_util::filesize(3 * 1024 * 1024));
|
|
|
|
EXPECT_EQ("3 GB", string_util::filesize((unsigned long long)3 * 1024 * 1024 * 1024));
|
|
|
|
EXPECT_EQ("3 TB", string_util::filesize((unsigned long long)3 * 1024 * 1024 * 1024 * 1024));
|
|
|
|
}
|
|
|
|
|
|
|
|
TEST(String, operators) {
|
|
|
|
string foo = "foobar";
|
|
|
|
EXPECT_EQ("foo", foo - "bar");
|
|
|
|
string baz = "bazbaz";
|
|
|
|
EXPECT_EQ("bazbaz", baz - "ba");
|
|
|
|
EXPECT_EQ("bazbaz", baz - "baZ");
|
|
|
|
EXPECT_EQ("bazbaz", baz - "bazbz");
|
|
|
|
string aaa = "aaa";
|
|
|
|
EXPECT_EQ("aaa", aaa - "aaaaa");
|
2016-10-24 23:47:00 +00:00
|
|
|
}
|