skip to main content
research-article

Translating Test Responses to Images for Test-termination Prediction via Multiple Machine Learning Strategies

Published: 13 August 2024 Publication History

Abstract

Failure diagnosis is a software-based, data-driven procedure. Collecting an excessive amount of fail data not only increases the overall test cost but can also potentially reduce diagnostic resolution. Thus, test-termination prediction is proposed to dynamically determine the appropriate failing test pattern to terminate testing, producing an amount of test data that is sufficient for an accurate diagnosis analysis. In this work, we describe a set of novel methods utilizing advanced machine learning techniques for efficient test-termination prediction. To implement this approach, we first generate images representing failing test responses from failure-log files. These images are then used to train a multi-layer convolutional neural network (CNN) incorporating a residual block. The trained CNN model leverages the images and known diagnostic results to determine the optimal test-termination strategy within the testing process, ensuring efficient and high-quality diagnosis. In addition to the integration of test response-to-image translation, our approach harnesses two cutting-edge learning strategies to enhance fail data and boost performance in subsequent tasks. The first strategy is transfer learning, which utilizes sample-label information from one circuit to guide the decision of whether to continue or stop testing for another circuit lacking labels. The second strategy involves the use of a generative deep model to generate fail data in the form of synthetic images. This technique increases the modeling effectiveness by expanding the volume of training samples. Experimental results conducted on actual failing chips and standard benchmarks validate that our proposed method surpasses existing approaches. Our method creates opportunities to harness the power of recent advances in machine learning for improving test and diagnosis efficiency.

References

[1]
Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, Sanjay Ghemawat, Geoffrey Irving, Michael Isard, Manjunath Kudlur, Josh Levenberg, Rajat Monga, Sherry Moore, Derek G. Murray, Benoit Steiner, Paul Tucker, Vijay Vasudevan, Pete Warden, Martin Wicke, Yuan Yu, and Xiaoqiang Zheng. 2016. TensorFlow: A system for large-scale machine learning. In 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI). 265–283.
[2]
Luca Amarú, Pierre-Emmanuel Gaillardon, and Giovanni De Micheli. 2015. The EPFL combinational benchmark suite. Proceedings of the 24th International Workshop on Logic Synthesis (IWLS). http://infoscience.epfl.ch/record/207551
[3]
Jacob Austin, Daniel D. Johnson, Jonathan Ho, Daniel Tarlow, and Rianne van den Berg. 2021. Structured denoising diffusion models in discrete state-spaces. In Advances in Neural Information Processing Systems (NeurIPS).
[4]
B. Benware, C. Schuermyer, M. Sharma, and T. Hermann. 2012. Determining a failure root cause distribution from a population of layout-aware scan diagnosis results. IEEE Design & Test of Computers 29, 1 (2012), 8–18.
[5]
R. D. Blanton, J. T. Chen, R. Desineni, K. N. Dwarakanath, W. Maly, and T. J. Vogels. 2002. Fault tuples in diagnosis of deep-submicron circuits. In Proceedings of the International Test Conference (ITC). 233–241.
[6]
S. Bodhe, M. E. Amyeen, I. Pomeranz, and S. Venkataraman. 2016. Diagnostic fail data minimization using an N-cover algorithm. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 24, 3 (2016), 1198–1202. DOI:
[7]
Shraddha Bodhe, Irith Pomeranz, M. Enamul Amyeen, and Srikanth Venkataraman. 2017. Reordering tests for efficient fail data collection and tester time reduction. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 25, 4 (2017), 1497–1505. DOI:
[8]
Cristiana Bolchini and Luca Cassano. 2016. A novel approach to incremental functional diagnosis for complex electronic boards. IEEE Trans. Comput. 65, 1 (2016), 42–52. DOI:
[9]
Mason Chern, Shih-Wei Lee, Shi-Yu Huang, Yu Huang, Gaurav Veda, Kun-Han (Hans) Tsai, and Wu-Tung Cheng. 2019. Improving scan chain diagnostic accuracy using multi-stage artificial neural networks. In 2019 24th Asia and South Pacific Design Automation Conference (ASP-DAC). 1–6.
[10]
C. H. Chuang, K. W. Hou, C. W. Wu, M. Lee, C. H. Tsai, H. Chen, and M. J. Wang. 2020. A deep learning-based screening method for improving the quality and reliability of integrated passive devices. In IEEE International Test Conference in Asia (ITC-Asia). 13–18. DOI:
[11]
J. Dean. 2020. The deep learning revolution and its implications for computer architecture and chip design. In IEEE International Solid- State Circuits Conference (ISSCC). 8–14. DOI:
[12]
Prafulla Dhariwal, Heewoo Jun, Christine Payne, Jong Wook Kim, Alec Radford, and Ilya Sutskever. 2020. Jukebox: A generative model for music. (2020). arXiv:2005.00341
[13]
Chun-Teng Chen, Chia-Heng Yen, Cheng-Yen Wen, Cheng-Hao Yang, Kai-Chiang Wu, Mason Chern, Ying-Yen Chen, Chun-Yi Kuo, Jih-Nung Lee, Shu-Yi Kao, and Mango Chia-Tso Chao. 2020. CNN-based stochastic regression for IDDQ outlier identification. In IEEE 38th VLSI Test Symposium (VTS). 1–6. DOI:
[14]
Chenlei Fang, Qicheng Huang, Soumya Mittal, and R. D. (Shawn) Blanton. 2019. Diagnosis outcome preview through learning. In IEEE 37th VLSI Test Symposium (VTS). 1–6. DOI:
[15]
Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, Francois Laviolette, Mario Marchand, and Victor Lempitsky. 2016. Domain-adversarial training of neural networks. Journal of Machine Learning Research (JMLR) 17, 1 (2016), 1–35.
[16]
Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Deep sparse rectifier neural networks. In Proceedings of the 14th International Conference on Artificial Intelligence and Statistics (AISTATS). 315–323.
[17]
Ian Goodfellow. 2016. NIPS 2016 tutorial: Generative adversarial networks. In Advances in Neural Information Processing Systems (NIPS).
[18]
Alex Graves, Marcus Liwicki, Santiago Fernández, Roman Bertolami, Horst Bunke, and Jürgen Schmidhuber. 2009. A novel connectionist system for unconstrained handwriting recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 31, 5 (2009), 855–868. DOI:
[19]
L. R. Gómez and H. Wunderlich. 2016. A neural-network-based fault classifier. In IEEE 25th Asian Test Symposium (ATS). 144–149. DOI:
[20]
K. He, X. Zhang, S. Ren, and J. Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 770–778. DOI:
[21]
Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. In Advances in Neural Information Processing Systems (NeurIPS), Vol. 33. 6840–6851.
[22]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural Computation 9 (121997), 1735–80. DOI:
[23]
Chun-Kai Hsu, Peter Sarson, Gregor Schatzberger, Friedrich Leisenberger, John Carulli, Siddhartha Siddhartha, and Kwang-Ting Cheng. 2016. Variation and failure characterization through pattern classification of test data from multiple test stages. In Proceedings of the International Test Conference (ITC).
[24]
Qicheng Huang, Chenlei Fang, and R. D. Shawn Blanton. 2020. Diagnosis outcome prediction on limited data via transferred random forest. In 2020 IEEE International Test Conference in Asia (ITC-Asia). 65–70. DOI:
[25]
Q. Huang, C. Fang, S. Mittal, and R. D. Blanton. 2018. Improving diagnosis efficiency via machine learning. In 2018 IEEE International Test Conference (ITC). 1–10. DOI:
[26]
Qicheng Huang, Chenlei Fang, Soumya Mittal, and R. D. (Shawn) Blanton. 2018. Improving diagnosis efficiency via machine learning. In Proceedings of the International Test Conference (ITC).
[27]
Y. Huang, J. Janicki, and S. Urban. 2019. Non-adaptive pattern reordering to improve scan chain diagnostic resolution. In 2019 IEEE European Test Symposium (ETS). 1–6. DOI:
[28]
Allan Jabri, David J. Fleet, and Ting Chen. 2023. Scalable adaptive computation for iterative generation. In International Conference on Machine Learning (ICML), Vol. 202. 14569–14589. https://proceedings.mlr.press/v202/jabri23a.html
[29]
Andrew B. Kahng. 2018. New directions for learning-based IC design tools and methodologies. In 2018 23rd Asia and South Pacific Design Automation Conference (ASP-DAC). 405–410.
[30]
Andrew B. Kahng. 2023. Machine learning for CAD/EDA: The road ahead. IEEE Design & Test 40, 1 (2023), 8–16. DOI:
[31]
Diederik Kingma and Jimmy Ba. 2015. Adam: A method for stochastic optimization. In 3rd International Conference on Learning Representations (ICLR).
[32]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Advances in Neural Information Processing Systems (NIPS). 1097–1105.
[33]
F. Lin and K. Cheng. 2017. An artificial neural network approach for screening test escapes. In 22nd Asia and South Pacific Design Automation Conference (ASP-DAC). 414–419. DOI:
[34]
Yue Lu, Thirumalai Vinjamoor Akhil Srinivas, Takaaki Nakamura, Makoto Imamura, and Eamonn Keogh. 2023. Matrix profile XXX: MADRID: A hyper-anytime and parameter-free algorithm to find time series anomalies of all lengths. In 2023 IEEE International Conference on Data Mining (ICDM). 1199–1204.
[35]
Calvin Luo. 2022. Understanding Diffusion Models: A Unified Perspective. (2022). arxiv:cs.LG/2208.11970
[36]
S. Millican, Y. Sun, S. Roy, and V. Agrawal. 2019. Applying neural networks to delay fault testing: Test point insertion and random circuit training. In IEEE 28th Asian Test Symposium (ATS). 13–18. DOI:
[37]
Grzegorz Mrugalski, Szczepan Urban, and Jakub Janicki. 2022. Suspect resolution for scan chain defect diagnosis. (Aug. 23, 2022). US Patent 11,423,202.
[38]
Mu Nie, Wen Jiang, Wankou Yang, Senling Wang, Xiaoqing Wen, and Tianming Ni. 2023. Enhancing defect diagnosis and localization in wafer map testing through weakly supervised learning. In 2023 IEEE 32nd Asian Test Symposium (ATS). 1–6.
[39]
Irith Pomeranz. 2014. Improving the accuracy of defect diagnosis by considering fewer tests. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD) 33, 12 (2014), 2010–2014. DOI:
[40]
Irith Pomeranz. 2015. Improving the accuracy of defect diagnosis by considering reduced diagnostic information. In IEEE 33rd VLSI Test Symposium (VTS). 1–6. DOI:
[41]
Irith Pomeranz. 2017. Fail data reduction for diagnosis of scan chain faults under transparent-scan. In 2017 IEEE 35th VLSI Test Symposium (VTS). 1–6. DOI:
[42]
Irith Pomeranz. 2023. Dummy faulty units for reduced fail data volume from logic faults. IEEE Transactions on Very Large Scale Integration (VLSI) Systems 31, 11 (2023), 1754–1762. DOI:
[43]
Irith Pomeranz. 2023. Partially specified output response for reduced fail data volume. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD) 42, 9 (2023), 3123–3127. DOI:
[44]
Irith Pomeranz and M. Enamul Amyeen. 2020. Hybrid pass/fail and full fail data for reduced fail data volume. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD) (2020), 1–1. DOI:
[45]
Irith Pomeranz, M. Enamul Amyeen, and Srikanth Venkataraman. 2017. Test modification for reduced volumes of fail data. ACM Transactions on Design Automation of Electronic Systems (TODAES) 22, 4, Article 67 (June2017), 17 pages. DOI:
[46]
Irith Pomeranz and Srikanth Venkataraman. 2020. LFSR-based test generation for reduced fail data volume. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD) 39, 12 (2020), 5261–5266. DOI:
[47]
Colin Raffel, Noam Shazeer, Adam Roberts, Katherine Lee, Sharan Narang, Michael Matena, Yanqi Zhou, Wei Li, and Peter J. Liu. 2020. Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research 21, 140 (2020), 1–67. http://jmlr.org/papers/v21/20-074.html
[48]
Sebastian Ruder. 2017. An overview of gradient descent optimization algorithms. (2017). arXiv:1609.04747
[49]
Chuanhe (Jay) Shan, Pietro Babighian, Yan Pan, John Carulli, and Li-C. Wang. 2017. Systematic defect detection methodology for volume diagnosis: A data mining perspective. In Proceedings of the International Test Conference (ITC). 1–10.
[50]
Alex Sherstinsky. 2020. Fundamentals of recurrent neural network (RNN) and long short-term memory (LSTM) network. Physica D: Nonlinear Phenomena 404 (2020), 132306. DOI:
[51]
M. Shintani, M. Inoue, and Y. Nakamura. 2018. Artificial neural network based test escape screening using generative model. In Proceedings of the International Test Conference (ITC). 1–8. DOI:
[52]
Karen Simonyan and Andrew Zisserman. 2015. Very deep convolutional networks for large-scale image recognition. (2015). arXiv:1409.1556
[53]
Jiaming Song, Chenlin Meng, and Stefano Ermon. 2020. Denoising diffusion implicit models. arXiv:2010.02502 (October2020). https://arxiv.org/abs/2010.02502
[54]
Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research (JMLR) 15, 1 (2014), 1929–1958.
[55]
Haralampos-G. Stratigopoulos. 2018. Machine learning applications in IC testing. In 2018 23rd IEEE European Test Symposium (ETS). 1–10.
[56]
Qianru Sun, Yaoyao Liu, Tat-Seng Chua, and Bernt Schiele. 2019. Meta-transfer learning for few-shot learning. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). 403–412. DOI:
[57]
Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott E. Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 1–9.
[58]
Wing Chiu Tam and R. D. (Shawn) Blanton. 2012. SLIDER: Simulation of layout-injected defects for electrical responses. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD) 31, 6 (2012), 918–929.
[59]
S. Tanwir, S. Prabhu, M. Hsiao, and L. Lingappan. 2015. Information-theoretic and statistical methods of failure log selection for improved diagnosis. In 2015 IEEE International Test Conference (ITC). 1–10. DOI:
[60]
S. Venkataraman and S. B. Drummonds. 2000. POIROT: A logic fault diagnosis tool and its applications. In Proceedings of the International Test Conference (ITC). 253–262.
[61]
Srikanth Venkataraman and W. Kent Fuchs. 1997. A deductive technique for diagnosis of bridging faults. In Proceedings of the International Conference on Computer-Aided Design (ICCAD). 1–6.
[62]
Hongfei Wang, Osei Poku, Xiaochun Yu, Sizhe Liu, Ibrahima Komara, and R. D. Blanton. 2012. Test-data volume optimization for diagnosis. In Proceedings of Design Automation Conference (DAC). 567–572.
[63]
N. Wang, I. Pomeranz, B. Benware, M. E. Amyeen, and S. Venkataraman. 2018. Improving the resolution of multiple defect diagnosis by removing and selecting tests. In 2018 IEEE International Symposium on Defect and Fault Tolerance in VLSI and Nanotechnology Systems (DFT). 1–6. DOI:
[64]
Xingyi Wang, Li Jiang, and Krishnendu Chakrabarty. 2020. LSTM-based analysis of temporally- and spatially-correlated signatures for intermittent fault detection. In IEEE 38th VLSI Test Symposium (VTS). 1–6. DOI:
[65]
Zixiao Wang, Yunheng Shen, Wenqian Zhao, Yang Bai, Guojin Chen, Farzan Farnia, and Bei Yu. 2023. DiffPattern: Layout pattern generation via discrete diffusion. In 2023 60th ACM/IEEE Design Automation Conference (DAC). 1–6. DOI:
[66]
Hongfei Wang, Wenjie Cai, Jianwen Li, and Kun He. 2020. Exploring graphical models with bayesian learning and MCMC for failure diagnosis. In 25th Asia and South Pacific Design Automation Conference (ASP-DAC). 151–156. DOI:
[67]
Joseph L. Watson, David Juergens, Nathaniel R. Bennett, Brian L. Trippe, Jason Yim, Helen E. Eisenach, Woody Ahern, Andrew J. Borst, Robert J. Ragotte, Lukas F. Milles, Basile I. M. Wicky, Nikita Hanikel, Samuel J. Pellock, Alexis Courbet, William Sheffler, Jue Wang, Preetham Venkatesh, Isaac Sappington, Susana Vázquez Torres, Anna Lauko, Valentin De Bortoli, Emile Mathieu, Sergey Ovchinnikov, Regina Barzilay, Tommi S. Jaakkola, Frank DiMaio, Minkyung Baek, and David Baker. 2023. De novo design of protein structure and function with RFdiffusion. In Nature, Vol. 620. 1089–1100.
[68]
Kevin E. Wu, Kevin K. Yang, Rianne van den Berg, Sarah Alamdari, James Y. Zou, Alex X. Lu, and Ava P. Amini. 2024. Protein structure generation via folding diffusion. In Nature Communications, Vol. 15. 1059:1–1059:12.
[69]
Yang Xue, Xin Li, and R. D. (Shawn) Blanton. 2018. Improving diagnostic resolution of failing ICs through learning. IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems 37, 6 (June2018), 1288–1297. DOI:
[70]
Yang Xue, Xin Li, R. D. (Shawn) Blanton, Carlston Lim, and M. Enamul Amyeen. 2016. Diagnostic resolution improvement through learning-guided physical failure analysis. In Proceedings of the International Test Conference (ITC). 1–10. DOI:
[71]
S. Yang. 1991. Logic Synthesis and Optimization Benchmarks User Guide: Version 3.0. Technical Report. MCNC Technical Report.
[72]
Chin-Chia Michael Yeh, Yan Zhu, Liudmila Ulanova, Nurjahan Begum, Yifei Ding, Hoang Anh Dau, Diego Furtado Silva, Abdullah Mueen, and Eamonn Keogh. 2016. Matrix profile I: All pairs similarity joins for time series: A unifying view that includes motifs, discords and shapelets. In 2016 IEEE 16th International Conference on Data Mining (ICDM). 1317–1322.

Index Terms

  1. Translating Test Responses to Images for Test-termination Prediction via Multiple Machine Learning Strategies

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Transactions on Design Automation of Electronic Systems
      ACM Transactions on Design Automation of Electronic Systems  Volume 29, Issue 5
      September 2024
      511 pages
      EISSN:1557-7309
      DOI:10.1145/3613682
      • Editor:
      • Jiang Hu
      Issue’s Table of Contents

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Journal Family

      Publication History

      Published: 13 August 2024
      Online AM: 25 April 2024
      Accepted: 16 April 2024
      Revised: 09 March 2024
      Received: 09 November 2023
      Published in TODAES Volume 29, Issue 5

      Check for updates

      Author Tags

      1. Test-termination prediction
      2. deep learning
      3. transfer learning
      4. diffusion models
      5. diagnosis

      Qualifiers

      • Research-article

      Funding Sources

      • National Natural Science Foundation of China (NSFC)

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • 0
        Total Citations
      • 252
        Total Downloads
      • Downloads (Last 12 months)252
      • Downloads (Last 6 weeks)5
      Reflects downloads up to 18 Feb 2025

      Other Metrics

      Citations

      View Options

      Login options

      Full Access

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Full Text

      View this article in Full Text.

      Full Text

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media