# Fast and online palindrome counting

For a recent project, I had to deal with the following subproblem.

# Problem

Given an alphabet and some property (not relevant to this post), find the length of the largest string that exhibits and also has the maximum number of distinct palindromes possible for a string of that size. It is known that there is a finite number of such strings.

Naturally, this calls for a simple backtracking solution where we start with the first letter in the alphabet and generate strings in lexicographic order. With each new string generated, if it satisfies and has the maximum number of possible palindromes then we follow that search path in the tree; otherwise, we prune it. However, the strings we are dealing with could go up to millions of characters. So we need to do this as fast as possible. But first, let’s have some background.

# Preliminaries

The first thing to observe is that a string of length will have at most palindromes (excluding the empty string). To convince yourself, try to construct a string by adding one letter at a time, and each time look at how many new distinct palindromes this new letter creates (it will be at most one).

Hence, in our backtracking algorithm, we want to maintain the number of palindromes that the current string has. With each letter added or removed, the algorithm should very quickly find the new number of palindromes. If a letter is added to the end then the number may increase, and if a letter is deleted from the end then it may decrease.

Such an algorithm is given by Rubinchik and Shur (paper link), where the primary idea is to construct a graph where each node represents a unique palindrome. This approach was first proposed by **Mikhail Rubinchik** at the **Петрозаводск (Petrozavodsk) summer camp 2014**.

# The data structure

There are two types of edges (pointers) in the data structure.

**Border edge**: A directed edge from to labeled , if for some .**Suffix edge**: An unlabeled directed edge from to , if is the longest proper palindromic suffix of .

Note that there could be a border edge for each possible letter, but there will be exactly one suffix edge for each palindrome.

Whenever we append a new letter to an already processed string, it takes amortized constant time to maintain this graph. Below is an example graph for the string `aababba`

.

Here denotes the empty string and is an imaginary palindrome of length . The *suffix edges* are shown by dashed lines, while the *border edges* are shown by solid lines with labels. We say that a palindrome consisting of a single letter *borders* , which makes the implementation of the algorithm easy.

# The algorithm

First, note that this graph will be a tree of nodes where each node will represent a palindrome. So we define a struct `Palindrome`

with the following properties and create a tree of them.

Here, `ALPH`

is the size of the alphabet , required to enable adding edges for each possible letter. The value of `Tree[u].envelope[i]`

stores the index `v`

such that `Tree[v]`

represents the palindrome `i Tree[u] i`

; `renvelope`

is just the reverse map for `envelope`

. Note that `i`

represents a single letter here and `Tree[u]`

represents the palindrome at index `u`

. Thus, `envelope`

maintains the **border edges** defined above.

We do not store the complete palindrome, but only a representation, which saves a lot of space. The field `len`

stores the length of the palindrome, and `lspIndex`

stores the index of the **longest proper palindromic suffix of this palindrome**. Thus, `lspIndex`

provides the **suffix edge** defined above.

Now the algorithm is straightforward.

- When a new letter
`nextChar`

is added to the string`S`

at the last position`pos`

, start from the current longest palindromic suffix (call it`LSP`

) in the string. - Go through suffix links to find the
`candidate`

suffix that may produce a new palindrome. It is guaranteed that we will find a candidate because we have the imaginary palindrome of length . This is done as follows

- After this loop, if the corresponding envelope is empty, we know that
`nextChar`

generates a new palindrome; otherwise it already exists.

- Finally, set
`Tree[LSP].lspIndex`

corresponding to the*suffix edge*for the new palindrome. This can be found again by traversing via suffix edges from the final candidate.

# Space and time requirements

## Space complexity is

If the string can be of length up to , then there are no more than nodes in the tree. This is because there will be at most palindromes including and .

## Time complexity is amortized per addition

To think about the time complexity, note that following a suffix edge always reduces the length of the current longest palindromic suffix. The length cannot be reduced more than times, hence, the amortized cost across all updates is , which makes the average cost of maintenance per update .