I guess the explanation would be that the states that imposed Jim Crow laws benefited financially from laws that ensured that blacks were paid less than whites and that may well be quantifiable and could be translated into unearned income which from a simplistic point of view could have been invested in real estate. Using a real estate value multiplier you could determine the amount of money lost to families which would have otherwise been passed down to subsequent generations.
As someone who does not hail from the south and doesn't have any southern history, it should not be your debt to repay as your family did not enjoy that benefit.