paper-with-me

홈 › Papers

Transformer models as an efficient replacement for statistical test suites to evaluate the quality of random numbers

2024-05-06 · Rishabh Goel, YiZi Xiao, Ramin Ramezani

Random numbers are incredibly important in a variety of fields, and the need for their validation remains important for safety. A Quantum Random Number Generator (QRNG) can theoretically generate truly random numbers, however their quality still needs to be thoroughly validated. Generally, the task of validating random numbers has been delegated to different statistical tests such as the tests from the NIST Statistical Test Suite (STS), which are often slow and only perform one test at a time. Our work presents a deep learning model utilizing the Transformer architecture that 1) performs multiple NIST STS tests at once, and 2) runs much faster. This model outputs multi-label classification results on passing these statistical tests. We performed a thorough hyper-parameter optimization to converge on the best possible model and as a result, achieved a high degree of accuracy with a Macro F1-score of above 0.96. We also compared this model to a conventional deep learning method (Long Short Term Memory Recurrent Neural Networks) to quantify randomness and showed our model achieved similar performances while being much more efficient and scalable. The high performance and efficiency of this Transformer-based deep learning model showed that it can be a viable replacement for the NIST STS for validating random numbers.

📄 PDF Abstract BibTeX arXiv:2405.03904

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONSTS

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Multi-Head Attention 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

Generalization Ability of Feature-based Performance Prediction Models: A Statistical Analysis across Benchmarks

2024-05-20 · Ana Nikolikj, Ana Kostovska, Gjorgjina Cenikj, Carola Doerr 외

This study examines the generalization ability of algorithm performance prediction models across various benchmark suites. Comparing the statistical similarity between the problem collections with the accuracy of perform…

Automating Autograding: Large Language Models as Test Suite Generators for Introductory Programming

2024-11-14 · Umar Alkafaween, Ibrahim Albluwi, Paul Denny

Automatically graded programming assignments provide instant feedback to students and significantly reduce manual grading time for instructors. However, creating comprehensive suites of test cases for programming problem…

Can Graphs Improve Tabular Foundation Models?

2025-12-13 · Franck Le, Keith Grueneberg, Erich Nahum, Vadim Sheinin arxiv

Tabular data are central to many real-world systems. While recent tabular transformers and in-context learners such as SAINT, TP-BERTa, TabPFN, TabICL, and MITRA incorporate limited inter-row reasoning, most approaches s…

Test Suites Task: Evaluation of Gender Fairness in MT with MuST-SHE and INES

2023-10-30 · Beatrice Savoldi, Marco Gaido, Matteo Negri, Luisa Bentivogli

As part of the WMT-2023 "Test suites" shared task, in this paper we summarize the results of two test suites evaluations: MuST-SHE-WMT23 and INES. By focusing on the en-de and de-en language pairs, we rely on these newly…

de-enFairness

On the Assessment of Benchmark Suites for Algorithm Comparison

2021-04-15 · David Issa Mattos, Lucas Ruud, Jan Bosch, Helena Holmström Olsson

Benchmark suites, i.e. a collection of benchmark functions, are widely used in the comparison of black-box optimization algorithms. Over the years, research has identified many desired qualities for benchmark suites, suc…

Benchmarking