Unbelievable setup! I had great joy of simply angle chasing and discovering and I wish to share with you.
$\triangle BFG$ is the reference triangle. $FP,GQ$ are given its external angle bisectors; let them meet at excenter $E$. Drop perpendiculars from $E$ onto $AB,BC$ and complete the square $ABCE$. Lets observe that $AEC$ is exact copy of $ABC$, so $\angle PEQ = 45^\circ$.
Now the fun begins. $\angle PEG=45^\circ=\angle PCG$, hence $PECG$ is cyclic. $\angle EPG$ being opposite to $\angle ECG$ is a right angle. Similarly $AFQE$ is cyclic, making $\angle FQE$ another right angle. Observe that $FG$ subtends $90^\circ$ at $B,P,Q$. As a result, $B,F,P,Q,G$ lie on same circle $!!$ Its center is $D$, midpoint of $FG$.
Now $DP=DF=$ radius of circle, $\angle DPF = \angle DFP = \angle PFA$ implying that $DP \parallel BA$. Hence $\triangle BPF$ and $\triangle BDF$ have same area. Take away their common area and we get $\triangle FRP$ and $\triangle BRD$ have same area. Similarly $DQ \parallel BC$ resulting in $\triangle GSQ$ and $\triangle BSD$ having same area. Adding the common area of $PRSQ$ to these, we see $FPQG$ and $\triangle BPQ$ have same area.
We do angle chasing one more time to find some lengths. $\angle BPC =$$ \angle PAB + \angle ABP = \angle PBQ + \angle ABP = \angle ABQ $. Therefore $\triangle ABQ \sim \triangle CPB$ by $AA$ similarity. So
$$\frac{AB}{PC}=\frac{AQ}{BC} \Rightarrow AB^2=9\times 8 \Rightarrow AB=6\sqrt{2} \Rightarrow AC=12$$
From this it is found $AP=3, PQ=5, QC=4 \, (!)$ Consequently, $$[FPQG]=[BPQ]=\frac{PQ}{AC}\times [ABC]=\frac{5}{12}\times 36=15 \quad \square$$
Let $r$ be the radius of the smaller circle, so the radius of the larger circle is $r\sqrt{2}$.
Firstly, $$\angle AO_1O=45^o\implies \angle ADO=22\frac12^o$$
So $$\angle DAO=67\frac12^o=\angle ACO$$
$$\implies \angle AOC=45^o\implies CE=EO=\frac{r}{\sqrt{2}}$$
The shaded area is then $$T=\frac12EO(CE+DO)=\frac12\cdot\frac{r}{\sqrt{2}}(\frac{r}{\sqrt{2}}+r+r\sqrt{2})$$
$$\implies T=\frac14r^2(3+\sqrt{2})$$
However, due to Pythagoras, $$r^2+(r\sqrt{2}+r)^2=(4\sqrt{2})^2$$
$$\implies r^2=\frac{32}{4+2\sqrt{2}}=8(2-\sqrt{2})$$
Hence $$T=\frac14(3+\sqrt{2})\cdot8(2-\sqrt{2})=2(4-\sqrt{2})$$
Best Answer
With the usual conventions:
\begin{aligned} \overrightarrow{GF}\times\overrightarrow{GB} &= (0,0,32)\\ \overrightarrow{GF}\times\overrightarrow{GC} &= (0,0,-18)\\ \overrightarrow{GA}+\overrightarrow{GB}+\overrightarrow{GC} &= \overrightarrow{0} \end{aligned}
The area you search: \begin{multline*} \frac{1}{2}\big\lvert\overrightarrow{GF}\times\overrightarrow{GA}\big\rvert=\frac{1}{2}\Big\lvert\overrightarrow{GF}\times\big(-\overrightarrow{GB}-\overrightarrow{GC}\big)\Big\rvert =\frac{1}{2}\big\lvert-\overrightarrow{GF}\times\overrightarrow{GB}-\overrightarrow{GF}\times\overrightarrow{GC}\big\rvert=\frac{1}{2}\big\lvert(0,0,-14)\big\rvert = 7 \end{multline*}