Is it possible to return just one namespace value instead of the full data point?

I have a high number of filters and have some necessary additional data - all indexed in restricts. I need to find a way to retrieve only one specific namespace value as well as the distance value and not the whole data point.

The FindNeighborsRequest allows to set ReturnFullDatapoint to true or false only. If I set it to true - I run out of memory because of the high load of filters. Increasing GrpcMaxReceiveSize is not an option, as it would also increase the search latency. If I set it to false, I cannot retrieve this data at all.

Is there any way to solve this issue?