Abstract
The iOk platform was presented, which combines the ParticlesNN web service and the DLgram and No Code ML Telegram bots for automatic search and analysis of objects in images using artificial intelligence. The platform allows one to work with any kind of images (electron, probe, and optical microscopy images and photographs) of any quality without preprocessing. Users can train a neural network on their own on their images. The results of image recognition are objects and their areas, sizes, and positions in the image. The services are in free access, and coding skills are not required to use them. The iOk platform is a user-friendly tool for working with any kind of images by automatically searching for objects and determining their parameters.
Similar content being viewed by others
REFERENCES
Nartova, A.V., Kovtunova, L.M., Khudorozhkov, A.K., Shefer, K.I., Shterk, G.V., Kvon, R.I., and Bukhtiyarov, V.I., Appl. Catal. A: Gen., 2018, vol. 566, p. 174.
Smirnov, M.Y., Vovk, E.I., Nartova, A.V., Kalinkin, A.V., and Bukhtiyarov, V.I., Kinet. Catal., 2018, vol. 59, pp. 653–662. https://doi.org/10.1134/S045388111805012X
Schindelin, J., Arganda-Carreras, I., Frise, E., Kaynig, V., Longair, M., Pietzsch, T., Preibisch, S., Rueden, C., Saalfeld, S., Schmid, B., Tinevez, J.-Y., White, D.J., Hartenstein, V., Eliceiri, K., Tomancak, P., and Cardona, A., Nat. Methods, 2010, vol. 9, p. 676.
Horcas, I., Fernandez, R., Gomez-Rodriguez, J.M., Colchero, J., Gomez-Herrero, J., and Baro, A.M., Rev. Sci. Instrum., 2007, p. 013705.
Krizhevsky, A., Sutskever, I., and Hinton, G., in Proceedings of the Annual Conference on Neural Information Processing Systems (NIP 2012), Lake Tahoe, NV, USA, December 3–8, 2012, p. 1.
Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C., Lecture Notes in Computer Science, Leibe, B., Matas, J., Sebe, N., and Welling M., Eds., Cham, Switzerland: Springer, 2016, vol. 9905, p. 21.
He, K., Gkioxari, G., Dollar, P., and Girshick, R., in Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, October 22–29, 2017, p. 2980.
Stringer, C., Michaelos, M., and Pachitariu, M., Nat. Methods, 2021, vol. 18, no. 1, p. 100.
Moen, E., Bannon, D., Kudo, T., Graf, W., Covert, M., and Valen, D., Nat. Methods, 2019, vol. 16, no. 12, p. 1233.
Caicedo, J., Goodman, A., Karhohs, K., Cimini, B., Ackerman, J., Haghighi, M., Heng, C., Becke, T., Doan, M., McQuin, C., Rohban, M., and Singh, S., Nat. Methods, 2019, vol. 16, no. 12, p. 1247.
Kudinov, V.Yu., Mashukov, M.Yu., Maslova, E.A., Orishchenko, K.E., Okunev, A.G., and Matveev, A.V., in Proceedings of the 2020 Science and Artificial Intelligence Conference, S.A.I.ence, Novosibirsk, Russia, 2020, p. 17.
Okunev, A.G., Mashukov, M.Y., Nartova, A.V., and Matveev, A.V., Nanomater, 2020, vol. 10, no. 7, p. 1285.
Fu, G., Sun, P., Zhu, W., Yang, J., Cao, Y., Ying-Yang, M., and Cao, Y.A., Opt. Lasers Eng., 2019, vol. 121, p. 397.
Berg, S., Kutra, D., Kroeger, T., Straehle, C., Kausler, B., Haubold, C., Schiegg, M., Ales, J., Beier, T., Rudy, M., Eren, K., Cervantes, J., Xu, B., Beuttenmueller, F., Wolny, A., Zhang, C., Koethe, U., Hamprecht, F., and Kreshuk, A., Nat. Methods, 2019, vol. 16, p. 1226.
Okunev, A.G., Nartova, A.V., and Matveev, A.V., in Proceedings of the International Multi-Conference on Engineering, Computer and Information Sciences (SIBIRCON), Novosibirsk, Russia, October 21–27, 2019, p. 0940.
Zhu, H., Ge, W., and Liu, Z., Appl. Sci., 2019, vol. 9, p. 3312.
Liu, Y., Xu, K., and Xu, J., Appl. Sci., 2019, vol. 9, p. 3127.
Feng, S., Zhou, H., and Dong, H., Mater. Des., 2019, vol. 162, p. 300.
Yang, T., Xiao, L., Gong, B., and Huang, L., in Proceedings of SPIE, Optoelectronic Imaging and Multimedia Technology VI, Dai, Q., Shimura, T., and Zheng Z., Eds., Bellingham, WA: International Society for Optics and Photonics, 2019, vol. 11187, p. 1118718.
Ziatdinov, M., Dyck, O., Maksov, A., Li, X., Sang, X., Xiao, K., Unocic, R., Vasudevan, R., Jesse, S., and Kalinin, S.V., ACS Nano, 2017, vol. 11, no. 2017, p. 12742.
Modarres, M.H., Aversa, R., Cozzini, S., Ciancio, R., Leto, A., and Brandino, G.P., Sci. Rep., 2017, vol. 7, p. 13282.
Qu, E.Z., Jimenez, A.M., Kumar, S.K., and Zhang, K., ACS Macromolecules, 2021, vol. 54, p. 3034.
Monchot, P., Coquelin, L., Guerroudj, K., Feltin, N., Delvallée, A., Crouzier, L., and Fischer, N., Nanomaterials, 2021, vol. 11, p. 968.
Nartova, A.V., Mashukov, M.Yu., Astakhov, R.R., Kudinov, V.Yu., Matveev, A.V., and Okunev, A.G., Catalysts, 2022, vol. 12, no. 2, p. 135.
Cai, Z. and Vasconcelos, N., in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, USA, June 18–22, 2018, p. 6154.
https://github.com/open-mmlab/ mmdetection. Accessed February 26, 2021.
Wada, K., Labelme: Image Polygonal Annotation with Python. GitHub repository. https://github.com/wkentaro/labelme. Accessed January 20, 2021.
Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., and Zisserman, A., Int. J. Comput. Vision, 2010, vol. 88, no. 2, p. 303.
COCO API–Dataset. https://github.com/cocodataset/cocoapi. Accessed June 1, 2020.
Matveev, A.V., Mashukov, M.Yu., Nartova, A.V., San’kova, N.N., and Okunev, A.G., Physical and Chemical Aspects of the Study of Clusters, Nanostructures and Nanomaterials, 2021, vol. 13, p. 300. https://doi.org/10.26456/pcascnn/2021.13.300
ACKNOWLEDGMENTS
We are grateful to L.M. Kovtunova for the preparation of supported catalysts on porous supports, as well as to colleagues from the Boreskov Institute of Catalysis, Siberian Branch, Russian Academy of Sciences, Novosibirsk, Russia, in particular, E. Yu. Gerasimov for TEM imaging.
Funding
The work was supported by the Russian Science Foundation (project no. 22-23-00951, https://rscf.ru/project/22-23-00951/).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
The authors declare that they have no conflicts of interest.
Additional information
Translated by V. Glyanchenko
Abbreviations and notation: TOF, turnover frequency (number of reaction cycles per active site per unit time); TEM, transmission electron microscopy; SPM, scanning probe microscopy; STM, scanning tunneling microscopy; TP, true positive (number of predicted contours that matched objects (contours labeled by the operator)); FP, false positive (number of predicted contours that do not have labeled contours); and FN, false negative (number of labeled contours that are not recognized by neural network).
Rights and permissions
About this article
Cite this article
Nartova, A.V., Matveev, A.V., Mashukov, M.Y. et al. iOk Platform for Automatic Search and Analysis of Objects in Images Using Artificial Intelligence in the Study of Supported Catalysts. Kinet Catal 64, 458–465 (2023). https://doi.org/10.1134/S0023158423040092
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0023158423040092