Does an abusive upbringing damage the brain?

There are well-known associations between abuse or neglect early in life and later psychological or psychiatric complications. What do we know of what goes on in the brain?