Computation of $\int_0^1 \frac{\arctan^2 x\ln x}{1+x}dx$
A framework proposed by Cornel (answer to the main integral)
The skeleton of the solution may be immediately obtained by using the strategy given for the generalization in Sect. $1.24$, page $14$, (Almost) Impossible Integrals, Sums, and Series (more precisely, see pages $142-145$). So, following the suggested strategy, we have that
$$\int_0^1 \frac{\arctan^2(x)\log(x)}{1+x}\textrm{d}x$$ $$=\frac{1}{2}\int_0^1 \frac{\arctan^2(x)\log(x)}{x}\textrm{d}x-\frac{1}{2}\int_0^{\infty} \frac{\arctan^2(x)\log(x)}{x(1+x)}\textrm{d}x+\frac{\pi}{2}\int_0^1 \frac{\arctan(x)\log(x)}{1+x}\textrm{d}x$$ $$-\frac{\pi^2}{8}\int_0^1\frac{\log(x)}{1+x}\textrm{d}x.$$
The resulting integrals are either known or manageable.
-
Behind the first resulting integral lies a very difficult harmonic series which is calculated by real methods here https://math.stackexchange.com/q/3803762.
-
The integral $\displaystyle \int_0^{\infty} \frac{\arctan^2(x)\log(x)}{x(1+x)}\textrm{d}x$ is reducible to the following integrals, $\displaystyle \int_0^1 \frac{x\log(1-x)}{1+x^2}\textrm{d}x$, $\displaystyle \int_0^1 \frac{x\log(1+x)}{1+x^2}\textrm{d}x$, $\displaystyle \int_0^1 \frac{x\log^2(x)\log(1-x)}{1+x^2}\textrm{d}x$, $\displaystyle \int_0^1 \frac{x\log^2(x)\log(1+x)}{1+x^2}\textrm{d}x$, $\displaystyle \int_0^1 \frac{\log(x)\log(1-x)}{1+x^2}\textrm{d}x$,$\displaystyle \int_0^1 \frac{\log(x)\log(1+x)}{1+x^2}\textrm{d}x$, where most of them are known or easily reducible to known harmonic series like the ones given at the previous link (see the third resulting integral). Here one also needs to calculate $\displaystyle \sum_{n=1}^{\infty}(-1)^{n-1}\frac{H_{2n}^{(3)}}{n}$ which is derived in a generalized form in the second theorem of the paper https://www.researchgate.net/publication/333339284_A_simple_strategy_of_calculating_two_alternating_harmonic_series_generalizations.
End of story
Another framework proposed by Cornel (answer to the second integral, $\displaystyle \int_0^1\frac{\ln^2(1+x^2)\ln x}{1+x^2}\textrm{d}x$)
Observe that $$\int_0^1 \frac{1}{1+x^2}\log^3\left(\frac{2x}{1+x^2}\right)\textrm{d}x$$ $$=\log^3(2)\int_0^1\frac{1}{1+x^2}\textrm{d}x+3\log^2(2)\int_0^1\frac{\log(x)}{1+x^2}\textrm{d}x+3\log(2)\int_0^1\frac{\log^2(x)}{1+x^2}\textrm{d}x$$ $$+\int_0^1\frac{\log^3(x)}{1+x^2}\textrm{d}x-3\log^2(2)\int_0^1\frac{\log(1+x^2)}{1+x^2}\textrm{d}x-6\log(2)\int_0^1\frac{\log(x)\log(1+x^2)}{1+x^2}\textrm{d}x$$ $$-3\int_0^1\frac{\log^2(x)\log(1+x^2)}{1+x^2}\textrm{d}x+3\log(2)\int_0^1\frac{\log^2(1+x^2)}{1+x^2}\textrm{d}x$$$$-\int_0^1\frac{\log^3(1+x^2)}{1+x^2}\textrm{d}x+3\color{blue}{\int_0^1\frac{\log(x)\log^2(1+x^2)}{1+x^2}\textrm{d}x}.$$
-
Note that the integral in the left-hand side may be beautifully reduced by the variable change $\displaystyle x\mapsto \frac{2x}{1+x^2}$ to $\displaystyle \int_0^1 \frac{1}{1+x^2}\log^3\left(\frac{2x}{1+x^2}\right)\textrm{d}x=\frac{1}{2}\int_0^1 \frac{\log^3(x)}{\sqrt{1-x^2}}\textrm{d}x$, where the last integral is a form involving the derivative of the Beta function.
-
Note that all the other resulting integrals in the right-hand side are already known.
-
To easily make the connection with the known integrals, for the integrals $\displaystyle \int_0^1\frac{\log^2(1+x^2)}{1+x^2}\textrm{d}x$ and $\displaystyle \int_0^1\frac{\log^3(1+x^2)}{1+x^2}\textrm{d}x$ make the variable change $x \mapsto \tan(x)$ to have a view in terms of trigonometric functions. A relevant link: About the integral $\int_{0}^{\pi/4}\log^4(\cos\theta)\,d\theta$
-
Also, you might like to know the following generalized integral, $\displaystyle \int_0^1\frac{\log^{2n}(x)\log(1+x^2)}{1+x^2}\textrm{d}x$, is nicely presented and calculated by Ali Shadhar in his book, An Introduction To The Harmonic Series And Logarithmic Integrals: For High School Students Up To Researchers (see page $149$). The integral easily and naturally reduces to forms involving derivatives of the Beta function.
End of story