I'd use SmartArt to create the basis of the chart you need and then yes I'd fill in the gaps with shapes & connectors. SmartArt won't give you this exact chart "straight out the box" but you could certainly save a bunch of time by creating the basis of it using SmartArt and then customise/addon where you need with shapes & connectors.