It sounds like you are setting different cost rate tables. To calculate the cost based on Cost Rate Table B, you'll need to change the assignment. Add the Cost Rate table field to the Task Usage view and swap the values. It will recalculate the Cost based upon the new rate table.