This means that the column where you are trying to use this formula in is a Yes/No column, but the result of your formula is a number and is neither a “Y” nor a “N”. Try changing the column type to Number.
It seems like you are using the SUM() expression inside of the “Row filter condition”, which is an expression that evaluates on each row of the table to decide if it’s going to be added to the slice or not
Usually people add a virtual column with the expression they want to get a SUM() of children records, but we don’t know exactly what your current setup is or why you would need that SUM()