BenchCouncil Transactions on Benchmarks, Standards and Evaluations (TBench) is an open-access, multi-disciplinary journal dedicated to advancing the science and engineering of evaluation. We extend a warm invitation to researchers from diverse disciplines to submit their work, with a particular emphasis on interdisciplinary research. Whether the research pertains to computers, artificial intelligence (AI), medicine, education, finance, business, psychology, or other social disciplines, all relevant contributions are highly valued and welcomed.At TBench, we place great importance on the reproducibility of research. We strongly encourage authors to ensure that their articles are appropriately prepared for open-source or artifact evaluation prior to submission. Areas of interest include, but are not limited to:1. Evaluation theory and methodologyFormal specification of evaluation requirementsDevelopment of evaluation modelsDesign and implementation of evaluation systemsAnalysis of evaluation riskCost modeling for evaluationsAccuracy modeling for evaluationsEvaluation traceabilityIdentification and establishment of evaluation conditionsEquivalent evaluation conditionsDesign of experimentsStatistical analysis techniques for evaluationsMethodologies and techniques for eliminating confounding factors in evaluationsAnalytical modeling techniques and validation of modelsSimulation and emulation-based modeling techniques and validation of modelsDevelopment of methodologies, metrics, abstractions, and algorithms specifically tailored for evaluations2. The engineering of evaluation Benchmark design and implementationBenchmark traceability Establishing least equivalent evaluation conditionsIndex design, implementationScale design, implementationEvaluation standard design and implementationsEvaluation and benchmark practice Tools for evaluationsReal-world evaluation systemsTestbed3. Data setExplicit or implicit problem definition deduced from the data setDetailed descriptions of research or industry datasets, including the methods used to collect the data and technical analyses supporting the quality of the measurementsAnalyses or meta-analyses of existing dataSystems, technologies, and techniques that advance data sharing and reuse to support reproducible researchTools that generate large-scale data while preserving their original characteristicsEvaluating the rigor and quality of the experiments used to generate the data and the completeness of the data description4. BenchmarkingSummary and review of state-of-the-art and state-of-the-practiceSearching and summarizing industry best practiceEvaluation and optimization of industry practiceRetrospective of industry practiceCharacterizing and optimizing real-world applications and systemsEvaluations of state-of-the-art solutions in the real-world setting5. Measurement and testingWorkload characterizationInstrumentation, sampling, tracing, and profiling of large-scale, real-world applications and systemsCollection and analysis of measurement and testing data that yield new insightsMeasurement and testing-based modeling (e.g., workloads, scaling behavior, and assessment of performance bottlenecks)Methods and tools to monitor and visualize measurement and testing dataSystems and algorithms that build on measurement and testing-based findingsReappraisal of previous empirical measurements and measurement-based conclusionsReappraisal of previous empirical testing and testing-based conclusionsEditorial Board
Researchers interested in submitting a special issue proposal should adhere to the Special Content Submission Guidelines.The International Journal on the Development and Application of Standards for Computers, Software Quality, Data Communications, Interfaces and MeasurementThe quality of software, well-defined interfaces (hardware and software), the process of digitalisation, and accepted standards in these fields are essential for building and exploiting complex computing, communication, multimedia and measuring systems. Standards can simplify the design and construction of individual hardware and software components and help to ensure satisfactory interworking.Computer Standards & Interfaces is an international journal dealing specifically with these topics.The journal • Provides information about activities and progress on the definition of computer standards, software quality, interfaces and methods, at national, European and international levels • Publishes critical comments on standards and standards activities • Disseminates user's experiences and case studies in the application and exploitation of established or emerging standards, interfaces and methods • Offers a forum for discussion on actual projects, standards, interfaces and methods by recognised experts • Stimulates relevant research by providing a specialised refereed medium.Computer Standards & Interfaces is concerned with the specification, development and application of standards and with high-level publications of developments and methods in the following areas: • Standards, Information Management, Formal Methods - Computers, Processors, Storage, Operating systems, Languages, Databases, Graphics, User interface, Multimedia, Information security, Office automation, Development of standards and instruments, Applications • Software Quality, Software Process - Languages, Operating systems, Programming, Requirements specification, Design & implementation, Inspection & test, Maintenance, Product and process evaluation, Performance, Tools, Metrics, Embedded systems, Software in measurement and technical systems including real-time aspects, Development of International Standards in Software Engineering • Distributed Systems, Open Systems, E-Topics - Digital interfaces, System and device buses, Fieldbuses, Data communication, Distributed computing, Protocols, Open systems interconnection, Local and wide area networks, Internet, Worldwide Web, Network security, Cryptology, E-services, E-business, E-commerce • Data Acquisition - Analog-to-digital conversion, Specification, Modelling, Industrial electronics, Real-time systems, Laboratory automation, Automatic measurement, Process control, Electromagnetic compatibility • Digital Instruments Standardisation - Forum of EUPAS, European Project for ADC-based devices, Standardisation (IMEKO TC-4 Working Group on A/D and D/A Converter Metrology), IEEE TC-10, IEC TC-42-WG8, IEC TC-85-WG16; Standardi-sation of specifications, modelling, testing, and analog and digital processing for digital instrumentsThe last issue of a volume includes an author index and a subject index.CS&I also covers general topics concerning the standardisation process, such as technical, political and commercial aspects of standards, their impact on the marketplace, cost/benefit analyses, legislative issues, and relationships among national and international standards bodies.
Visit the journal's proposal guidelines to submit a proposal for a special issue (original contributions on a topic within the scope of the journal) or a special section with extended papers from a conference of workshop within the scope of the journal.Information and Software Technology is the international archival journal focusing on research and experience that contributes to the improvement of software development practices. The journal's scope includes methods and techniques to better engineer software and manage its development. Articles submitted for review should have a clear component of software engineering or address ways to improve the engineering and management of software development. Areas covered by the journal include: • Software management, quality and metrics, • Software processes, • Software architecture, modelling, specification, design and programming • Functional and non-functional software requirements • Software testing and verification & validation • Empirical studies of all aspects of engineering and managing software development Short Communications is a new section dedicated to short papers addressing new ideas, controversial opinions, "Negative" results and much more. Read the Guide for authors for more information.The journal encourages and welcomes submissions of systematic literature studies (reviews and maps) within the scope of the journal. Information and Software Technology is the premiere outlet for systematic literature studies in software engineering. Guidelines for conducting systematic reviews are provided here.Benefits to authors We also provide many author benefits, such as free PDFs, a liberal copyright policy, special discounts on Elsevier publications and much more. Please click here for more information on our author services.Please see our Guide for Authors for information on article submission. If you require any further information or help, please visit our Support Center.