Demolition of the Icon office building in Stevenage begins this month and is expected to take 20 weeks, making way for flats.
The new development on the Lytton Way site will see 576 flats in seven blocks up to 16 storeys high.
Stevenage Borough Council refused planning permission, concerned about the height, design and appearance of the development, and that the project would be "an over development of the site which would be harmful to the character and appearance of the area".
The local authority also raised concerns over the "demand on the infrastructure".
However, two subsequent public inquiries found in the developer's favour, with one planning inspector saying "the adverse impacts would be insufficient to outweigh the benefits".
Construction is due to begin in the spring.
Comments: Our rules
We want our comments to be a lively and valuable part of our community - a place where readers can debate and engage with the most important local issues. The ability to comment on our stories is a privilege, not a right, however, and that privilege may be withdrawn if it is abused or misused.
Please report any comments that break our rules.
Read the rules here