The value of \(\tan^{-1}5+\tan^{-1}3-\cot^{-1}\displaystyle\frac{4}{7}\) is
Answer & explanation
Correct answer: option 2
The correct answer is Option (2) → \(\displaystyle\frac{\pi}{2}\)
For x, y > 0 with xy > 1, the sum formula is
\( \displaystyle \tan^{-1}x + \tan^{-1}y = \pi + \tan^{-1}\frac{x+y}{1-xy} \)
Here x = 5, y = 3, xy = 15 > 1:
\( \displaystyle \tan^{-1}5 + \tan^{-1}3 = \pi + \tan^{-1}\frac{8}{-14} = \pi - \tan^{-1}\frac{4}{7} \)
Also \(\cot^{-1}\frac{4}{7} = \tan^{-1}\frac{7}{4}\). So the expression is
\( \displaystyle \pi - \left(\tan^{-1}\frac{4}{7} + \tan^{-1}\frac{7}{4}\right) \)
Since \(\tan^{-1}a + \tan^{-1}\frac{1}{a} = \frac{\pi}{2}\) for a > 0:
\( \displaystyle = \pi - \frac{\pi}{2} = \frac{\pi}{2} \)
Note: This topic was not in the CUET 2026 syllabus.