Название: Distributional Reinforcement Learning
Автор: Marc G. Bellemare, Will Dabney, Mark Rowland
Издательство: The MIT Press
Серия: Adaptive Computation and Machine Learning
Год: 2023
Страниц: 379
Язык: английский
Формат: epub (true)
Размер: 13.4 MB

The first comprehensive guide to Distributional Reinforcement Learning, providing a new mathematical formalism for thinking about decisions from a probabilistic perspective. Distributional Reinforcement Learning is a new mathematical formalism for thinking about decisions. Going beyond the common approach to reinforcement learning and expected values, it focuses on the total reward or return obtained as a consequence of an agent's choices—specifically, how this return behaves from a probabilistic perspective. How is distributional reinforcement learning different? In reinforcement learning, the value function describes the expected return that one would counterfactually obtain from beginning in any given state. It is reasonable to say that its fundamental object of interest – the expected return – is a scalar and that algorithms that operate on value functions operate on collections of scalars (one per state). On the other hand, the fundamental object of distributional reinforcement learning is a probability distribution over returns: the return distribution. The return distribution characterizes the probability of different returns that can be obtained as an agent interacts with its environment from a given state. Distributional reinforcement learning algorithms operate on collections of probability distributions that we call return-distribution functions (or simply return functions).

Название: Domain Theory in Computer Science
Автор: Jovan Pehcevski
Издательство: Arcler Press
Год: 2023
Страниц: 356
Язык: английский
Формат: pdf (true)
Размер: 31.6 MB

This book covers different topics from domain theory in computer science, including: partial orders and groups, power domains and metrics, recursive data types (binary trees) and algebraicity and Boolean algebras. Section 1 focuses on partial orders and groups, describing characterizations and properties of a new partial order, natural partial orders on transformation semigroups with fixed sets, cyclic soft groups and their applications on groups, and factorization of groups involving symmetric and alternating groups. Section 2 focuses on power domains and metrics, describing FS+ domains, topology of GB-metric spaces, incoherency problems in a combination of description logics and rules, and metrics for multiset-theoretic subgraphs. Section 3 focuses on recursive data types (binary trees), describing binary tree’s recursion traversal algorithm and its improvement, the design of the minimum spanning tree algorithms, generating tree-lists by fusing individual tree detection and nearest neighbor imputation using airborne LIDAR data, a recursive approach to the Kauffman bracket, and a novel multiway splits decision tree for multiple types of data.

Название: Биоинформатика с Python. Книга рецептов. Современные библиотеки и приложения Python для решения реальных задач вычислительной биологии
Автор: Тиаго Антао
Издательство: ДМК Пресс
Год: 2023
Страниц: 345
Язык: русский
Формат: pdf
Размер: 19.9 MB

Биоинформатика — активная область исследований, в которой используется ряд простых и сложных вычислений для извлечения ценной информации из биологических данных. Из книги вы узнаете, как управлять этими задачами с помощью языка Python. Вы рассмотрите ключевые методы секвенирования нового поколения, анализа отдельных клеток, геномики, метагеномики, а также узнаете, как применяются алгоритмы машинного обучения в биоинформатике. Одной из самых сильных сторон Python является обилие высококачественных научных библиотек и библиотек для обработки данных. В основе всех них лежит NumPy, который обеспечивает эффективную поддержку массивов и матриц. В дополнениях NumPy мы можем найти почти все научные библиотеки. Например, в нашей сфере есть Biopython. Но в нашей области можно использовать и другие общие библиотеки анализа данных. Так, Pandas является стандартом де-факто для обработки табличных данных. Совсем недавно библиотека Apache Arrow дала эффективную реализацию некоторых функций Pandas, а также совместимость языков. Наконец, Matplotlib является наиболее распространенной библиотекой для построения диаграмм в пространстве Python и подходит для научных вычислений.

Название: Jetpack Compose 1.3 Essentials: Developing Android Apps with Jetpack Compose 1.3, Android Studio, and Kotlin
Автор: Neil Smyth
Издательство: Payload Media
Год: 2023 (Rev: 1.0)
Страниц: 574
Язык: английский
Формат: pdf (true), epub (true)
Размер: 50.9 MB

This book aims to teach you how to build Android applications using Jetpack Compose 1.3, Android Studio Flamingo (2022.2.1), Material Design 3, and the Kotlin programming language. The book begins with the basics by explaining how to set up an Android Studio development environment. The book also includes in-depth chapters introducing the Kotlin programming language, including data types, operators, control flow, functions, lambdas, coroutines, and object-oriented programming. An introduction to the key concepts of Jetpack Compose and Android project architecture is followed by a guided tour of Android Studio in Compose development mode. The book also covers the creation of custom Composables and explains how functions are combined to create user interface layouts, including row, column, box, and list components.

Название: Python Clean Code: Best Practices and Techniques for Writing Clear, Concise, and Maintainable Code
Автор: Nash Maverick
Издательство: Vigilant Vaults
Год: 2023
Страниц: 126
Язык: английский
Формат: pdf, epub, mobi
Размер: 10.2 MB

"Python Clean Code" is a comprehensive guidebook for Python developers who want to improve the quality of their code by adopting best practices for writing clean, readable, and maintainable code. The book is authored by Nash Maverick, who has many years of experience in software development and has worked with multiple programming languages. The book is divided into four parts, each covering a specific aspect of clean code development. Part 1 focuses on the fundamentals of clean code, including the definition of clean code, the importance of code readability, and the benefits of writing clean code. Part 2 delves into the specifics of writing clean code in Python, such as choosing clear and concise names, following the PEP 8 style guide, and handling errors and exceptions. Part 3 highlights the common mistakes developers make while writing clean code and provides solutions for avoiding these mistakes. Finally, Part 4 covers the best practices for writing clean code, such as establishing coding standards, encouraging code reviews, and continuously improving code quality.

Название: Cognitive Digital Twins for Smart Lifecycle Management of Built Environment and Infrastructure: Challenges, Opportunities
Автор: Ibrahim Yitmen
Издательство: CRC Press
Год: 2023
Страниц: 240
Язык: английский
Формат: pdf (true)
Размер: 12.2 MB

This book provides knowledge into Cognitive Digital Twins for smart lifecycle management of built environment and infrastructure focusing on challenges and opportunities. It focuses on the challenges and opportunities of data-driven cognitive systems by integrating the heterogeneous data from multiple resources that can easily be used in a Machine Learning model and adjust the algorithms. It comprises Digital Twins incorporating cognitive features that will enable sensing complex and unpredicted behavior and reason about dynamic strategies for process optimization to support decision-making in lifecycle management of the built environment and infrastructure. The book introduces the Knowledge Graph (KG)-centric framework for Cognitive Digital Twins involving process modeling and simulation, ontology-based Knowledge Graph, analytics for process optimizations, and interfaces for data operability. It offers contributions of Cognitive Digital Twins for the integration of IoT, Big Data, Artificial Intelligence, smart sensors, Machine Learning and communication technologies, all connected to a novel paradigm of self-learning hybrid models with proactive cognitive capabilities.

Название: Основы алгоритмизации и программирования на Visual C++
Автор(ы): Гуриков С.Р.
Издательство: Инфра-М
Год: 2022
Страниц: 514
Формат: PDF
Размер: 103 Мб
Язык: русский

В учебном пособии рассмотрены основы алгоритмизации и программирования на языке Visual C++ для разработки Windows-приложений и создания консольных программ. Содержится описание работы линейных, разветвляющихся и циклических структур, принципов обработки одномерных и двумерных массивов, порядка создания DLL-библиотек и модулей, методов работы с файлами. Много внимания уделено принципам создания пользовательского интерфейса с помощью элементов управления. Объяснены приемы программирования тестовых вопросов. Рассмотрены методы вывода информации в базу данных Microsoft Access, текстовый редактор Microsoft Word и табличный процессор Microsoft Excel.

Название: Computational Mathematics: An introduction to Numerical Analysis and Scientific Computing with Python
Автор: Dimitrios Mitsotakis
Издательство: CRC Press
Год: 2023
Страниц: 529
Язык: английский
Формат: pdf (true)
Размер: 125.8 MB

This textbook is a comprehensive introduction to computational mathematics and scientific computing suitable for undergraduate and postgraduate courses. It presents both practical and theoretical aspects of the subject, as well as advantages and pitfalls of classical numerical methods alongside with computer code and experiments in Python. Each chapter closes with modern applications in physics, engineering, and Computer Science. In this book, we present all the material in Python. Python is a free programming language with a wide variety of extensions. These include extensions to Data Science and Machine Learning, as well as more traditional areas, such as the numerical solution of differential equations. Python comes with functions for almost every method we present in this book, which makes Python a great pedagogical tool. The computer code you will find in this book is written in such a simple way that experts in Python will find my coding style very naive. However, I believe that this style helps students to learn programming.

Название: Information and coding theory in computer science
Автор: Zoran Gacovski
Издательство: Arcler Press
Год: 2023
Страниц: 416
Язык: английский
Формат: pdf (true)
Размер: 36.0 MB

This book covers different topics from information theory methods and approaches, block and stream coding, lossless data compression, and information and Shannon entropy. Section 1 focuses on information theory methods and approaches, describing information theory of cognitive radio system, information theory and entropies for quantized optical waves in complex time-varying media, some inequalities in information theory using Tsallis entropy, and computational theory of intelligence: information entropy. Section 2 focuses on block and stream coding, describing block-split array coding algorithm for long-stream data compression, bit-error aware lossless image compression with 2d-layer-block coding, beam pattern scanning (BPS) versus space-time block coding (STBC) and space-time trellis coding (STTC), partial feedback based orthogonal space-time block coding with flexible feedback bits, and rate-less space-time block codes for 5G wireless communication systems. Section 3 focuses on lossless data compression, describing lossless image compression technique using combination methods, new results in perceptually lossless compression of hyperspectral images, lossless compression of digital mammography using base switching method, and lossless image compression based on multiple-tables arithmetic coding.

Название: Архитектура и проектирование программных систем
Автор(ы): Назаров С.В.
Издательство: Инфра-М
Год: 2023
Страниц: 375
Формат: PDF
Размер: 115 Мб
Язык: русский

Рассмотрены технологии и проблемы создания больших программных систем, их архитектуры и жизненный цикл. Основное внимание обращено на разработку и анализ требований, определение спецификаций, методы и средства проектирования архитектуры программных систем и техникоэкономический анализ проектов. Уделено значительное внимание рефакторингу программных систем, в том числе архитектурному рефакторингу.