By God!: expressing wonderment, zeal.
A minced oath, an expression of dismay, disgust, anger, surprise etc.
Used like "what the hell" to add emphasis.