Search results for "transformer"

showing 10 items of 96 documents

A Lite Romanian BERT: ALR-BERT

2022

Large-scale pre-trained language representation and its promising performance in various downstream applications have become an area of interest in the field of natural language processing (NLP). There has been huge interest in further increasing the model’s size in order to outperform the best previously obtained performances. However, at some point, increasing the model’s parameters may lead to reaching its saturation point due to the limited capacity of GPU/TPU. In addition to this, such models are mostly available in English or a shared multilingual structure. Hence, in this paper, we propose a lite BERT trained on a large corpus solely in the Romanian language, which we cal…

Human-Computer InteractionComputer Networks and CommunicationsBERT; transformers; ALBERT; NLP; RomanianVDP::Teknologi: 500::Informasjons- og kommunikasjonsteknologi: 550Computers
researchProduct

Alternatīvas neironu mašīntulkošanas arhitektūras

2020

Pētījuma mērķis: Izpētīt alternatīvas mašīntulkošanas arhitektūras, pielietojot jaunas pieejas, lai izveidotu angļu-latviešu tulkotāju un apvienot attēlu ar teikumu matricu vienā modelī. Nozīmīgākie rezultāti: Darba ietvaros tika uztrēnēti dažādi mašīntulkotāji. Viens balstās uz «transformer» arhitektūru. Šis modeļis uztrenēts pilnīgi no jauna. Otrs mašīntulkotājs balstās uz pretrenētiem modeliem. Darbā tika salīdzinātas dažādas pieejas un tika izvēlēts labākais pretrenēts modelis XLM-R, uz kura bāzes izveidots tulkotājs. Pirmajā tulkotājā iegūtie tulkojuma rezultāti ir pietiekami precīzi un gramatiski pareizi. Taču šis tulkotājs pielāgots politiski vai juridiski virzītam tekstam, jo uztren…

InceptionV3TransformerDatorzinātneXLM-RBERTmachine translation
researchProduct

On the design of a high current power supply for superconducting magnet

2002

The purpose of the article is the description, considerations of design and presentation of experimental results of a high current (1000 A) and low voltage (up to 15 V) converter for the excitement of superconducting corrector magnets in particle accelerators. The power source, which is based on a ZVT converter, presents high efficiency, small output ripple, excellent regulation of line, and fulfilment of the EMC normative (VDE 0871 A).

InductanceEngineeringbusiness.industryMagnetRippleElectrical engineeringSuperconducting magnetbusinessInductorLow voltageCurrent transformerPower (physics)PESC Record. 27th Annual IEEE Power Electronics Specialists Conference
researchProduct

Nonlinear scaled models in 3D calculation of transformer magnetic circuits

2006

PurposeTo make easier and faster the designing of transformers using scale models.Design/methodology/approachThe scale modeling in designing of transformers is included. Both computer and physical models of high leakage reactance (HLR) and 3‐phase (TP3C) transformers have been considered. The 3D field computations have been executed for the scaled models, and the results were recalculated to the full‐scaled ones.FindingsIt is possible to calculate the scale coefficients for nonlinear models of transformers using finite element method (FEM) software. Obtained coefficients are useful in the designing process. Measurements confirm correctness of the scaling laws.Research limitations/implicatio…

Leakage inductanceEngineeringbusiness.industryApplied MathematicsComputationFinite element methodComputer Science Applicationslaw.inventionNonlinear systemComputational Theory and MathematicslawEddy currentElectronic engineeringElectrical and Electronic EngineeringTransformerbusinessScale modelScalingCOMPEL - The international journal for computation and mathematics in electrical and electronic engineering
researchProduct

Monolingual and cross-lingual intent detection without training data in target languages

2021

Due to recent DNN advancements, many NLP problems can be effectively solved using transformer-based models and supervised data. Unfortunately, such data is not available in some languages. This research is based on assumptions that (1) training data can be obtained by the machine translating it from another language

Machine translationTK7800-8360Computer Networks and CommunicationsComputer sciencePT languages0211 other engineering and technologies02 engineering and technologycomputer.software_genre[INFO.INFO-CL]Computer Science [cs]/Computation and Language [cs.CL]DEGermanFRLTLV0202 electrical engineering electronic engineering information engineeringEN DE FR LT LV PT languagesmonolingual and cross-lingual experimentsElectrical and Electronic Engineering021110 strategic defence & security studiesbusiness.industryCosine similarityLatvian020206 networking & telecommunicationsLithuanianEager learningword and sentence transformerslanguage.human_languageLazy learningHardware and ArchitectureControl and Systems EngineeringSignal ProcessinglanguageENArtificial intelligenceElectronicsbusinesscomputerSentenceNatural language processingBERT
researchProduct

Analysis of the electromagnetic radiation generated by a multipactor discharge occurring within a microwave passive component

2010

International audience; Multipactoring is a non-linear phenomenon that appears in highpower microwave equipments operating under vacuum conditions and causes several undesirable effects. In this manuscript, a theoretical and experimental study of the RF spectrum radiated by a multipactor discharge, occurring within a realistic microwave component based on rectangular waveguides, is reported. The electromagnetic coupling of a multipactor current to the fundamental propagative mode of a uniform waveguide has been analyzed in the context of the microwave network theory. The discharge produced under a single-carrier RF voltage regime has been approached as a shunt current source exciting such a…

Materials scienceAcoustics and Ultrasonics52.20.Fs01 natural sciencesElectromagnetic radiationlaw.inventionOpticslaw0103 physical sciences010306 general physicsTransformer84.40.Ua010302 applied physicsbusiness.industryCurrent sourceCondensed Matter PhysicsSurfaces Coatings and FilmsElectronic Optical and Magnetic MaterialsHarmonics41.20.Jb29.27.-aEquivalent circuitRadio frequencybusinessWaveguideMicrowave
researchProduct

Modeling and Experimental Verification of Ultrasound Transmission in Electro Insulation Oil

2012

A verification study of ultrasound transmission numerical simulation results with experiment results is presented in this paper. The work considers a model of a transformer tank which is filled with electro insulating oil. In the experiment, performed under laboratory conditions, an ultrasound wave is generated by a piezoelectric transducer that is fixed in the centre of the tank and measured by another transducer mounted inside the tank at three distances: 10, 20 and 30 cm from the sound source. The transducer is able to measure and generate acoustic waves in the ultrasound frequency band up to 1 MHz. The simulation considers numerical calculation of acoustic pressure distribution inside t…

Materials scienceAcoustics and UltrasonicsComputer simulationFrequency bandTransformer oilAcousticsAcoustic wavePiezoelectricitylaw.inventionTransducerComputer Science::SoundlawTransformerSound pressureArchives of Acoustics
researchProduct

The influence of the temperature of insulation oil on the results of measurements of the acoustic emission signals generated by partial discharges

2005

The subject matter of this paper refers to the improvement of the acoustic emission method (AE) used for evaluation of partial discharges (PDs) generated in paper-oil insulation systems of power appliances. The paper presents the measurement and analysis results of the AE signals generated by partial discharges of the surface type (SPDs). The AE signals were measured on the surface of a transformer tub using a broad-band contact transducer, and then they were subject to a time-frequency analysis. The measurements were taken while heating transformer oil in the range from 30 to 85°C with gradation of every 5°C. For time runs, amplitude and energy density spectra the descriptor values that ch…

Materials scienceAmplitudeTransducerAcoustic emissionlawTransformer oilAcousticsEnergy densityGeneral Physics and AstronomyGradationTransformerSpectral linelaw.inventionJournal de Physique IV (Proceedings)
researchProduct

Design and experimental validation of a high voltage ratio DC/DC converter for proton exchange membrane electrolyzer applications

2019

Abstract This paper deals with hydrogen production via water electrolysis, which is considered the most attractive and promising solution. Specifically, the use of renewable energy sources, such as wind electric power generators, is hypothesized for supplying the electrolyzer, aiming to strongly reduce the environmental impact. In particular, micro-wind energy conversion systems (μWECSs) are attractive for their low cost and easy installation. In order to interface the μWECS and the electrolyzer, suitable power conditioning systems such as step-down DC-DC converters are mandatory. However, due to the requested high conversion ratio between the DC bus grid, i.e. the output of a three-phase d…

Materials scienceHigh conversion ratioEnergy Engineering and Power TechnologyElectric generatorControl technique02 engineering and technology010402 general chemistry01 natural sciences7. Clean energylaw.inventionSettore ING-INF/04 - AutomaticalawDC/DC converterElectrolyzerTransformerWind energyComputingMilieux_MISCELLANEOUSRenewable Energy Sustainability and the EnvironmentBuck converterbusiness.industry[SPI.NRJ]Engineering Sciences [physics]/Electric powerElectrical engineeringModelingInsulated-gate bipolar transistorConverters021001 nanoscience & nanotechnologyCondensed Matter PhysicsDC-BUS0104 chemical sciencesFuel TechnologyElectric power0210 nano-technologybusinessVoltage
researchProduct

Research on the electrostatic properties of liquid dielectric mixtures

2007

Abstract This paper presents research results, which confirm the possibility of influencing the electrostatic charge tendency (ECT) of selected mixtures of purely insulating liquids. Tests were performed in a spinning disk system, where the factors influencing the value of the electrification current consisted of variable composition of the toluene–cyclohexane mixture, rotational speed, and a disk diameter. Liquid hydrocarbon mixtures displayed changes in ECT as well as classic insulation parameters such as resistivity and relative permittivity for concentration changes of the admixtures. These results can be used to assist the search for inhibitors of ECT and of aging processes in insulati…

Materials scienceTransformer oilLiquid dielectricRelative permittivityRotational speedCondensed Matter PhysicsElectric chargeSurfaces Coatings and FilmsElectronic Optical and Magnetic MaterialsHydrocarbon mixtureschemistry.chemical_compoundchemistryElectrical resistivity and conductivityElectronic engineeringElectrical and Electronic EngineeringCurrent (fluid)Composite materialBiotechnologyJournal of Electrostatics
researchProduct