CrossEncoder based on cross-encoder/stsb-roberta-base

This is a Cross Encoder model finetuned from cross-encoder/stsb-roberta-base using the sentence-transformers library. It computes scores for pairs of texts, which can be used for text reranking and semantic search.

Model Details

Model Description

Model Type: Cross Encoder
Base model: cross-encoder/stsb-roberta-base
Maximum Sequence Length: 512 tokens
Number of Output Labels: 1 label
Supported Modality: Text

Model Sources

Documentation: Sentence Transformers Documentation
Documentation: Cross Encoder Documentation
Repository: Sentence Transformers on GitHub
Hugging Face: Cross Encoders on Hugging Face

Full Model Architecture

CrossEncoder(
  (0): Transformer({'transformer_task': 'sequence-classification', 'modality_config': {'text': {'method': 'forward', 'method_output_name': 'logits'}}, 'module_output_name': 'scores', 'architecture': 'RobertaForSequenceClassification'})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import CrossEncoder

# Download from the 🤗 Hub
model = CrossEncoder("cross_encoder_model_id")
# Get scores for pairs of inputs
pairs = [
    ["SummaryDynamic and motivated IT professional with around 7 years of experience as a Big Data Engineer with expertise in designing data intensive applications using Hadoop Ecosystem , Big Data Analytical , Cloud Data engineering , Data Warehouse / Data Mart, Data Visualization , Reporting , and Data Quality solutions .In - depth knowledge of Hadoop architecture and its components like YARN , HDFS, Name Node, Data Node, Job Tracker, Application Master, Resource Manager , Task Tracker and Map Reduce programming paradigm.Extensive experience in Hadoop led development of enterprise level solutions utilizing Hadoop components such as Apache Spark, MapReduce, HDFS, Sqoop, PIG, Hive, HBase, Oozie, Flume, NiFi, Kafka, Zookeeper, and YARN.Profound experience in performing Data Ingestion, Data Processing (Transformations, enrichment, and aggregations).Strong Knowledge on Architecture of Distributed systems and Parallel processing, In-depth understanding of MapReduce programming paradigm and Spark execution framework.Experienced with the Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark Context , Spark-SQL , Dataframe API , Spark Streaming, MLlib , Pair RDD 's and worked explicitly on PySpark and Scala .Handled ingestion of data from different data sources into HDFS using Sqoop, Flume and perform transformations using Hive, Map Reduce and then loading data into HDFS.Managed Sqoop jobs with incremental load to populate HIVE external tables. Experience in importing streaming data into HDFS using Flume sources, and Flume sinks and transforming the data using Flume interceptors.Experience in Oozie and workflow scheduler to manage Hadoop jobs by Direct Acyclic Graph ( DAG ) of actions with control flows.Implemented the security requirements for Hadoop and integrating with Kerberos authentication infrastructure- KDC server setup, creating realm /domain, managing.Experience of Partitions, bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance .Experience with different file formats like Avro , parquet , ORC , Json and XML .Expertise in Creating, Debugging, Scheduling and Monitoring jobs using Airflow and Oozie.Experienced with using most common Operators in Airflow - Python Operator, Bash Operator, Google Cloud Storage Download Operator, Google Cloud Storage Object Sensor.Hands-on experience in handling database issues and connections with SQL and NoSQL databases such as MongoDB , HBase , Cassandra , SQL server , and PostgreSQL .Created Java apps to handle data in MongoDB and HBase. Used Phoenix to create SQL layer on HBase.Experience in designing and creating RDBMS Tables, Views, User Created Data Types, Indexes, Stored Procedures, Cursors, Triggers and Transactions.Expert in designing ETL data flows using creating mappings/workflows to extract data from SQL Server and Data Migration and Transformation from Oracle/Access/Excel Sheets using SQL Server SSIS .Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.Hands-on experience with Amazon EC2, Amazon S3, Amazon RDS, VPC, IAM, Amazon Elastic Load Balancing, Auto Scaling, CloudWatch, SNS, SES, SQS, Lambda, EMR and other services of the AWS family.Created and configured new batch job in Denodo scheduler with email notification capabilities and Implemented Cluster setting for multiple Denodo node and created load balance for improving performance activity.Instantiated, created, and maintained CI/CD (continuous integration & deployment) pipelines and apply automation to environments and applications.Worked on various automation tools like GIT, Terraform, Ansible. Experienced in fact dimensional modeling ( Star schema, Snowflake schema ), transactional modeling and SCD (Slowly changing dimension)Experienced with JSON based RESTful web services, and XML/QML based SOAP web services and also worked on various applications using python integrated IDEs like Sublime Text and PyCharm .Efficient Cloud Engineer with years of experience assembling cloud infrastructure. Utilizes strong managerial skills by negotiating with vendors and coordinating tasks with other IT team members. Implements best practices to create cloud functions, applications and databases.\nSkills·Big Data Technologies:Hadoop, MapReduce, HDFS, Sqoop, PIG, Hive, HBase, Oozie, Flume, NiFi, Kafka, Zookeeper, Yarn, Apache Spark, Mahout, Sparklib·Databases:Oracle, MySQL, SQL Server, MongoDB, Cassandra, DynamoDB, PostgreSQL, Teradata, Cosmos.·Programming:Python, PySpark, Scala, Java, C, C++, Shell script, Perl script, SQL·Cloud Technologies:AWS, Microsoft Azure·Frameworks:Django REST framework, MVC, Hortonworks·Tools:PyCharm, Eclipse, Visual Studio, SQL*Plus, SQL Developer, TOAD, SQL Navigator, Query Analyzer, SQL Server Management Studio, SQL Assistance, Eclipse, Postman·Versioning tools:SVN, Git, GitHub·Operating Systems:Windows 7/8/XP/2008/2012, Ubuntu Linux, MacOS·Network Security:Kerberos·Database Modelling:Dimension Modeling, ER Modeling, Star Schema Modeling, Snowflake Modeling·Monitoring Tool:Apache Airflow·Visualization/ Reporting:Tableau, ggplot2, matplotlib, SSRS and Power BI·Machine Learning Techniques:Linear & Logistic Regression, Classification and Regression Trees, Random Forest, Associative rules, NLP and Clustering.\nExperienceAWS Data Engineer,01/2022-02/2022Deloitte–Ann Arbor,MI,Designed and setup Enterprise Data Lake to provide support for various uses cases including Analytics, processing, storing and Reporting of voluminous, rapidly changing dataResponsible for maintaining quality reference data in source by performing operations such as cleaning, transformation and ensuring Integrity in a relational environment by working closely with the stakeholders & solution architectDesigned and developed Security Framework to provide fine grained access to objects in AWS S3 using AWS Lambda, DynamoDBSet up and worked on Kerberos authentication principals to establish secure network communication on cluster and testing of HDFS, Hive, Pig and MapReduce to access cluster for new usersPerformed end- to-end Architecture & implementation assessment of various AWS services like Amazon EMR, Redshift, S3Implemented the machine learning algorithms using python to predict the quantity a user might want to order for a specific item so we can automatically suggest using kinesis firehose and S3 data lakeUsed AWS EMR to transform and move large amounts of data into and out of other AWS data stores and databases, such as Amazon Simple Storage Service (Amazon S3) and Amazon DynamoDBUsed Spark SQL for Scala & amp, Python interface that automatically converts RDD case classes to schema RDDImport the data from different sources like HDFS/HBase into Spark RDD and perform computations using PySpark to generate the output responseCreating Lambda functions with Boto3 to deregister unused AMIs in all application regions to reduce the cost for EC2 resourcesImporting & exporting database using SQL Server Integrations Services (SSIS) and Data Transformation Services (DTS Packages)Coded Teradata BTEQ scripts to load, transform data, fix defects like SCD 2 date chaining, cleaning up duplicatesDeveloped reusable framework to be leveraged for future migrations that automates ETL from RDBMS systems to the Data Lake utilizing Spark Data Sources and Hive data objectsConducted Data blending, Data preparation using Alteryx and SQL for Tableau consumption and publishing data sources to Tableau serverDeveloped Kibana Dashboards based on the Log stash data and Integrated different source and target systems into Elasticsearch for near real time log analysis of monitoring End to End transactionsImplemented AWS Step Functions to automate and orchestrate the Amazon SageMaker related tasks such as publishing data to S3, training ML model and deploying it for predictionIntegrated Apache Airflow with AWS to monitor multi-stage ML workflows with the tasks running on Amazon SageMakerEnvironment: AWS EMR, S3, RDS, Redshift, Lambda, Boto3, DynamoDB, Amazon SageMaker, Apache Spark, HBase, Apache Kafka, HIVE, SQOOP, Map Reduce, Snowflake, Apache Pig, Python, SSRS, TableauAssessed organization technology infrastructure and managed cloud migration process.Configured computing, networking and security systems within cloud environment.Implemented cloud policies, managed technology requests and maintained service availability.Data Engineer,01/2016-11/2019Honeywell–Huntsville,AL,Worked on Azure Data Factory to integrate data of both on-prem (MY SQL, Cassandra) and cloud (Blob storage, Azure SQL DB) and applied transformations to load back to Azure SynapseManaged, Configured and scheduled resources across the cluster using Azure Kubernetes ServiceMonitored Spark cluster using Log Analytics and Ambari Web UITransitioned log storage from Cassandra to Azure SQL Datawarehouse and improved the query performanceInvolved in developing data ingestion pipelines on Azure HDInsight Spark cluster using Azure Data Factory and Spark SQLAlso Worked with Cosmos DB (SQL API and Mongo API)Develop dashboards and visualizations to help business users analyze data as well as providing data insight to upper management with a focus on Microsoft products like SQL Server Reporting Services (SSRS) and Power BIPerformed the migration of large data sets to Databricks (Spark), create and administer cluster, load data, configure data pipelines, loading data from ADLS Gen2 to Databricks using ADF pipelinesCreated various pipelines to load the data from Azure data lake into Staging SQLDB and followed by to Azure SQL DBCreated Databrick notebooks to streamline and curate the data for various business use cases and also mounted blob storage on DatabrickUtilized Azure Logic Apps to build workflows to schedule and automate batch jobs by integrating apps, ADF pipelines, and other services like HTTP requests, email triggers etcWorked extensively on Azure data factory including data transformations, Integration Runtimes, Azure Key Vaults, Triggers and migrating data factory pipelines to higher environments using ARM TemplatesIngested data in mini-batches and performs RDD transformations on those mini-batches of data by using Spark Streaming to perform streaming analytics in Data bricksEnvironment: Azure SQL DW, Databrick, Azure Synapse, Cosmos DB, ADF, SSRS, Power BI, Azure Data lake, ARM, Azure HDInsight, Blob storage, Apache Spark.Adept in troubleshooting and identifying current issues and providing effective solutions.Managed performance monitoring and tuning while identifying and repairing issues within database realm.Identified key use cases and associated reference architectures for market segments and industry verticals.Designed surveys, opinion polls, and assessment tools to collect data.Tested, validated and reformulated models to foster accurate prediction of outcomes.Created graphs and charts detailing data analysis results.Recommended data analysis tools to address business issues.Developed new functions and applications to conduct analyses.Cleaned and manipulated raw data.Collaborated with solution architects to define database and analytics engagement strategies for operational territories and key accounts.Big Data Engineer / Hadoop Developer,10/2013-12/2015Infosys Ltd–Irwindale,CA,AnsibleDenodoDenodoCloudWatchAvroPySparkPySparkPySparkMLlibDataframeNiFiNiFiInteracted with business partners, Business Analysts and product owner to understand requirements and build scalable distributed data solutions using Hadoop ecosystemDeveloped Spark Streaming programs to process near real time data from Kafka, and process data with both stateless and state full transformationsWorked with HIVE data warehouse infrastructure-creating tables, data distribution by implementing partitioning and bucketing, writing and optimizing the HQL queriesBuilt and implemented automated procedures to split large files into smaller batches of data to facilitate FTP transfer which reduced 60% of execution timeWorked on developing ETL processes (Data Stage Open Studio) to load data from multiple data sources to HDFS using FLUME and SQOOP, and performed structural modifications using Map Reduce, HIVED eveloping Spark scripts, UDFS using both Spark DSL and Spark SQL query for data aggregation, querying, and writing data back into RDBMS through SqoopWritten multiple MapReduce Jobs using Java API, Pig and Hive for data extraction, transformation and aggregationAvrom multiple file formats including Parquet, Avro, XML, JSON, CSV, ORCFILE and other compressed file formats Codecs like gZip, Snappy, LzoStrong understanding of Partitioning, bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performanceDeveloped PIG UDFs for manipulating the data according to Business Requirements and also worked on developing custom PIG LoadersDeveloping ETL pipelines in and out of data warehouse using combination of Python and Snowflakes SnowSQL Writing SQL queries against SnowflakeExperience in report writing using SQL Server Reporting Services (SSRS) and creating various types of reports like drill down, Parameterized, Cascading, Conditional, Table, Matrix, Chart and Sub ReportsUsed DataStax Spark connector which is used to store the data into Cassandra database or get the data from Cassandra databaseWrote oozie scripts and setting up workflow using Apache Oozie workflow engine for managing and scheduling Hadoop jobsWorked on implementation of a log producer in Scala that watches for application logs, transform incremental log and sends them to a Kafka and Zookeeper based log collection platformUsed Hive to analyze data ingested into HBase by using Hive-HBase integration and compute various metrics for reporting on the dashboardTransformed tPySpark using AWS Glue dynamic frames with PySpark; cataloged the transformed the data using Crawlers and scheduled the job and crawler using workflow featureWorked on installing cluster, commissioning & decommissioning of data node, name node recovery, capacity planning, and slots configurationDeveloped data pipeline programs with Spark Scala APIs, data aggregations with Hive, and formatting data (JSON) for visualization, and generatiPySparkEnvironment: AWS, Cassandra, PySpark, Apache Spark, HBase, Apache Kafka, HIVE, SQOOP, FLUME, Apache oozie, Zookeeper, ETL, UDF, Map Reduce, Snowflake, Apache Pig, Python, Java, SSRSOnfidentialDeveloped and implemented Hadoop code while observing coding standards.Optimized and tuned Hadoop environments and modified hardware to meet prescribed performance thresholds.Developed new functions and applications to conduct analyses.Created graphs and charts detailing data analysis results.Tested, validated and reformulated models to foster accurate prediction of outcomes.Python Developer,09/2012-10/2013Fiserv–City,STATE,AWS, S3, EC2, LAMBDA, EBS, IAM, Datadog, CloudTrail, CLI, Ansible, MySQL, Python, Git, Jenkins, DynamoDB, Cloud Watch, Docker, KubernetesLeveraged open communication, collective decision-making and thorough reviews to create performant and scalable systems.Worked with server-side and front-end technologies and leveraged common design patterns to code dynamic and user-friendly systems.Implemented new API routes, architected new ORM structures and refactored code to boost application performance.Harnessed version control tools to coordinate project development and individual code submissions.Introduced cloud-based technologies into Python development to expand on-premise deployment options.Wrote clear and clean code for use in projects.Resolved customer issues by establishing workarounds and solutions to debug and create defect fixes.\nEducation and TrainingMaster of Science:Data Engineering,Expected in05/2023-George Mason University-Fairfax,VAGPA:Status-Bachelor of Engineering:Computer Networking And Telecommunications,Expected in05/2019-University of Mumbai-India,GPA:Status-", 'RoleGaming Business AnalystResponsibilities Ability to understand vast amounts of data, identify and fix data issues Strong in database and Data Warehousing concepts Strong in TSQL Data analysis and presentation Data insight generation Strong reporting using Power BI, Power Apps & Excel Ability to succeed in a fast-paced, dynamic business environment Excellent technical & analytical skills with strong business acumen Strong communication skillsRequired SkillsProven experience as a Gaming Domain Expert, Game Analyst, or similar role within the gaming industry.Passion about gaming and a genuine interest in the gaming industry.Strong communication and presentation skills to effectively convey research findings to both technical and non-technical stakeholders.Strong analytical skills and ability to interpret complex data sets to derive meaningful insights.Should be able to do the qualitative and quantitative Research on gaming data such as competitor trends, product performance, consumers, games, and acquisitions .Excellent research abilities, with a proactive approach to stay updated on industry developments.Must have Deep understanding of Gaming Industry trends to perform ad-hoc analysis and research across a broad range of industries.Deep knowledge and understanding of gaming platforms, game genres, player behavior, and industry trends, patterns, and insights for game console, games, and subscriptions across all gaming companies.Analyze internal game meta data and KPIs and helping in curating the game, genre, publisher, developer etc.Identify key takeaways based on research, prepare presentations, communicate with business stakeholders.Should be able to build the forecasting model for any game or game franchise.Perform Market studies, consumer insights, competitive analysis, ad hoc reporting, and market trends across the gaming and game development industries.Basic Understanding of T-SQLFamiliarity with data analysis tools and techniques.Should be able to create the pivots in Excel from Relational models for slice and dice the data.Ability to understand vast amounts of data.Identify and fix data issues ,Data analysis and presentation ,Data insight generation.Ability to thrive in a fast-paced, dynamic business environment ,Excellent technical & analytical skills with strong business acumen ,Strong communication skills,SQL, ExcelGood to have skillsDigital : PythonExperience Required (in Yrs.)5+ YearsWork LocationBellevue, USA'],
    ['Summary8+ years of accomplished experience in the field of accounting Team and organizational training from a major global public corporation Exceptionally fast, efficient and organized Knowledge of all accounting functions: GL, PL, and BS - budgets, forecasting, variance analysis, trend analysis, financial reporting, reconciliations, work papers, journal entries, accruals, AP, AR Experience in GAAP and Statutory accounting and monthly and year-end closing processes\nHighlightsOracle Financial, PeopleSoft, Microsoft Dynamics Nav, Microsoft Office Suite, Outlook, Lotus Notes\nExperience06/2015toPresentSenior AccountantGartner|Redwood City,CA,Prepare, examine, or analyze accounting records, financial statements, or other financial reports to assess accuracy, completeness, and conformance to reporting and procedural standards.Process, prepare and maintain reporting related to Inventory, and all associated recurring and/or ad hoc journal entries, account analysis, financial reporting, account reconciliation and system interface analysis, (COGS, Rebates, Adjustments, Other Revenues) in accordance with established general accounting policies and procedures Summarize vendor contracts and/or annual contract amendments to extract financial pertinent information to determine rebate configuration for monthly/quarterly invoicing Create, review revenue loaders, rebate, billing invoices and track the payment status Prepare communications such as memos, presentation charts, and process documentation, and coordinate with other departments with assembling information for reporting results Maintain Sox controls and departmental documentation Train new staff and review the work of less experienced staff Cross training with other team members in other accounting functions.09/2013to05/2014Accountant IIGraphic Packaging|West Monroe,LA,Completed assigned reconciliations accurately, completely and in the time frame required by corporate policies Prepared and ensured accuracy and integrity of accounting and transactional records to ensure proper financial reporting Worked with internal Financial Reporting personnel to support timely and accurate completion of monthly, quarterly and annual internal and external reporting Processed and maintained assigned ad hoc or recurring journal entries in a timely and accurate manner Ensured that interfaces between ancillary systems and the general ledger are processed timely and accurately so that the affected assigned general ledger accounts are complete, accurate and properly classified Independently reviewed revenue and expense accounts for accuracy; determined proper accruals Jessica Claire Resume \t     \t\t\tPage 2 of 2 Independently provided prompt, courteous and professional customer service to internal and external users of information provided by the Accounting department Worked with external audit firm to support timely completion of audits or compliance reporting Assisted other departments with compiling information and reporting results and variances.12/2008to01/2013Accountant IIGraphic Packaging|Shelbyville,IL,Assisted in the month/year end close and preparation of associated journal entries Performed detailed analysis of the general ledger in conjunction with the month end close Responsible for the preparation of foreign branch balance sheets, income statements, and fixed assets schedules and reconciliations Verified and analyzed monthly and quarterly underwriting activity as reported by foreign branches, subsidiaries and affiliates, Pools and Syndicates Recognized and investigated unusual results utilizing all available resources and effectively communicated findings to management Analyzed and recorded foreign branch results on home office books, interacting with other areas, to ensure the accuracy of journal entries Reconciled ledger balances resulting from underwriting activity, account settlements, and profit and loss on foreign exchange and between sub-ledger and general ledger to insure accurate figures before monthly sub-ledger close Cash settlements through wire transfers, electronic receipts, check deposits, ach payments, and check requests.10/2006to06/2008AssociateAce Hardware|Clarks Summit,PA,Developed, coordinated and planned expense budgets, forecasts, headcount monitoring and tracking and consolidated and analyzed trends of the expenses for Compensation and Planning within Agency Division successfully ended the year within +/- 2% variance to forecast.Prepared, updated and monitored monthly Financial Analysis Summaries and budget templates for the monthly financial management presentations including actual and projected results.Coordinated with section managers to prepare budget uploads and monthly Budget versus Actual meetings.Prepared recurring and ad-hoc journal entries and provided ad hoc analysis reporting to management as needed, such as identifying spending trends, analyzing variances, or for other purposes as requested.\nEducationExpected intotoMasters of Science|AccountingKEAN UNIVERSITY,,NJGPA:AccountingExpected intotoBachelor of Science|Management Science,,GPA:Management Science\nSkillsaccount reconciliation, Accounting, general accounting, accruals, ad, Agency, balance sheets, billing, budgets, Budget, charts, compliance reporting, contracts, customer service, documentation, financial, Financial Analysis, financial management, financial reports, Financial Reporting, financial statements, fixed assets, foreign exchange, frame, general ledger, general ledger accounts, home office, Inventory, invoicing, ledger, Lotus Notes, meetings, Microsoft Dynamics, Microsoft Office Suite, Outlook, month end close, Oracle Financial, PeopleSoft, personnel, policies, presentations, profit and loss, reporting, settlements, underwriting', 'Job Title: Senior AccountantLocation: Atlanta, GA (Hybrid)Duration: 12+ Months (Contract)\nThe candidate will assist in  be responsible for:Day-to-day general ledger accounting, including journal entry preparation and related reporting in the areas of Prepaids, Accruals, Payroll, Benefits, and Intercompany  Related Party processes.Assist in the monthly accounting close procedures including proper period end cut-off and accounting close schedule.Calculating and maintaining payroll related and cost accruals to ensure accurate monthly cut off.Monitoring elements leading to cross margin  profitability analysis and support to project management.Maintenance of chart of accounts and cost center reporting.\nQualifications:Bachelors degree in accounting or finance (concentration in Accounting) preferred.10+ years of accounting experience (General Ledger, AR, AP, Cash Management).5+ years of financial analysis.Audit background a plus.Experience working in an international and cross-cultural environment.Experience with SAPR3 or S4 (FI) required.Experience with SAP BW, SAP CRM is a plus.Proficiency in knowledge of US GAAP, IFRS Accounting, and US Tax.Strong PC skills with advanced knowledge in Excel and PPT.'],
    ["SummaryHighly motivated Sales Associate with extensive customer service and sales experience. Outgoing sales professional with track record of driving increased sales, improving buying experience and elevating company profile with target market.\nSkillsTimberline, MRI, YARDI, Peachtree, Peoplesoft, OneSite, QuickBooks\nMicrosoft Word and Excel\nExperience07/2014toPresentACCOUNTANTArizona State University–Tempe,AZ,I am an experienced and goal-oriented Accountant with a demonstrated track record in preparation and analysis of financial reports to summarize and forecast financial position.Independent contributor committed to superior quality, teamwork and proficient internal and external customer service.An Accountant experienced in driving efficiency, productivity, and implementation of process improvements to support achievement of overall corporate goals and objectives.Core competencies include:.Accounting Management.Cash Management FDH Velocitel provides all the services needed to design, build, optimize, upgrade and maintain broadcast and wireless infrastructure.FDH Velocitel develops innovative solutions for evaluating the condition of heavy civil structures, such as bridges, dams and levees.04/2010to07/2014Accounting ManagerAdt Security Services, Inc–Aiea,HI,Responsible for financial management functions including preparation and delivery of monthly/quarterly financial statements, and variance analysis for several cost centers.Responsible for processing of general accounting functions, balance sheet account reconciliation, time and material and AIA billing for Government work, inventory, and job costing.Responsible for coordination of annual audit and government auditing.Implemented an inventory system.Assisted in implementation of percentage of completion reporting for revenue.Assisted in Accounting system upgrade Northwood Ravin is a leading multifamily development, construction and property management firm serving the Southeast.05/2005to06/2009Senior AccountantGenesee & Wyoming Inc.–Wolcott,IN,Responsible for property and development accounting for several entities which includes preparation financial statements.Work closely with Developers and property management personnel.Responsible for the full accounting cycle from entering budgets, editing accounts payable, managing entity cash, general ledger reconciliation and reconciling bank statements.Monthly duties include sending out financial packages to owners as required.Mortgage payments.Retail/Parking Deck management accounting.Prepare annual audit schedules and work with external auditors.Jessica          Page 2.Update Fixed Assets.Payment of real estate and personal property taxes.Prepare personal property tax schedules.Provide information to owners.Prepare draws for bank funding.Provide banks with all required information for that funding.Liaison with the banks.Diebold Fire Services provides comprehensive products and services in Virginia, North Carolina and South Carolina to meet company's fire, security and life safety needs.11/2004to05/2005Finance Manager/AccountantAdtran–Portland,OR,Responsible for financial management functions including preparation and delivery of monthly/quarterly financial statements, variance analysis, and financial forecasts.Oversight and processing of general accounting functions, including AR/AP, balance sheet account reconciliation, billing, payroll, inventory, job costing, inter-company reconciliation, monthly and quarterly sales and payroll tax preparation and cash management.Served as a key leader in managing an accounting system conversion from three different ERPs to Solomon in local offices.Coordinated efforts incorporating two local level acquisitions into current business with corporate office.Developed a plan for segregation of duties among five different locations.Mid-City Urban, LLC is in the Security Brokers, Dealers and Flotation Companies industry with annual sales of $1M- $5M.11/2001to11/2004Assistant ControllerKimley-Horn And Associates, Inc.–Denton,TX,Responsible for overseeing accounting procedures, internal controls (implementing, monitoring, enhancing), and database management.Prepared financial reports, developed budgets, and performed variance analysis in accordance with business plan.Supervised monthly contract billings to outside financial sources.Assisted in tax return preparation.Bozzuto Management Company offers apartment living and management services for nearly 100 properties throughout the East Coast.01/1999to01/2001Project AccountantApartment Investment & Management Co–City,STATE,Closed and compiled monthly financial reporting packages for management and owners of residential developments.Performed monthly account reconciliations and monitored general ledger transactions.Consistently met deadlines while demonstrating strong analytical and problem-solving skills to achieve corporate objectives.Prepared audit papers to several different audit firms such as Deloitte & Touche.Report packages included cash flow statements and a written explanation of variance analysis.AIMCO owns or operates multi-family properties in numerous states nationwide.\nEducation and TrainingExpected in1993totoBachelor of Science:Accounting & FinanceUniversity of South Carolina - Upstate-Spartanburg,SCGPA:Accounting & Finance\nSkillsaccount reconciliation, account reconciliations, accounting, Accountant, general accounting, Accounting Management, Accounting system, accounts payable, acquisitions, ABC, AIA, AP, AR, auditing, balance sheet, reconciling bank statements, billing, billings, bridges, broadcast, budgets, business plan, cash flow, Cash Management, conversion, customer service, database management, delivery, driving, editing, financial, forecast financial, financial forecasts, financial management, financial reports, financial reporting, financial statements, Fixed Assets, general ledger, Government, inventory, job costing, managing, Excel, office, Microsoft Word, payroll, Peachtree, Peoplesoft, personnel, problem-solving skills, property management, quality, QuickBooks, real estate, reporting, Retail, safety, sales, Solomon, tax, taxes, tax return preparation, tax preparation, teamwork, Timberline, upgrade, variance analysis, written", 'As a Solution Architect - Data Engineering, you will work for an American multinational technology company focusing on various technological domains such as artificial intelligence, online advertising, search engine technology, cloud computing, computer software, quantum computing, e-commerce, and consumer electronics. The job requires expertise in Databricks, a cloud-based data engineering platform.\nKey responsibilities:Provide technical leadership in a post-sales capacity to guide strategic customers as they design and implement big data projects, ranging from architectural design to data engineering to model deployment.Identify and drive new initiatives that enable customers to turn their data into actionable business value and align these initiatives with their business outcomes for continued success.Architect production-level workloads, including end-to-end pipeline load performance testing and optimization.Deliver tutorials and training to drive community adoption (including hackathons, conference presentations, etc.)Work closely with Engineering and Product Management to drive the direction of the Databricks product.Contribute to Databricks SME community. Required SkillsHands-on and technical expertise with Apache SparkProven experience of design and implementation experience in big data technologies including Hadoop, NoSQL, MPP, OLTP, OLAP5+ years Experience working as either: Software EngineerData Engineer: query tuning, performance tuning, troubleshooting, and debugging Spark andor other big data solutions.Comfortable programming in Python, Scala, or JavaExperience using and designing solutions on cloud infrastructure and services, such as AWS, Azure, or GCPExperience with Development Tools for CICD, Unit and Integration testing, Automation and Orchestration, REST API, BI tools, and SQL Interfaces. E.g. Jenkins.Excellent communication skills and comfortable presenting to strategic stakeholdersleadership.Experience in customer-facing pre-sales, post-sales, technical architecture guidance, or consulting.Passionate about learning new technologies and making customers successfulData ScienceML Engineer experience in model selection, model lifecycle, hyper-parameter tuning, model serving, and deep learning, using tools like MLFlow desired.\n Life at CapgeminiCapgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:Flexible workHealthcare, including dental, vision, mental health, and well-being programsFinancial well-being programs such as 401(k) and Employee Share Ownership PlanPaid time off and paid holidaysPaid parental leaveFamily-building benefits like adoption assistance, surrogacy, and cryopreservationSocial well-being benefits like subsidized backup childelder care and tutoringMentoring, coaching, and learning programsEmployee Resource GroupsDisaster Relief'],
    ["SummaryTo seek employment as a Project Engineer in my desired field ( Full time / Part Time)\nHighlightsA competent Project Engineer with excellent communication, organization and co-ordination skills. Possessing a proven track record of preparing and executing project plans and programs, ensuring that work is carried out in accordance with the companies procedures and clients satisfaction. Able to ensure timely, safe and cost effective design and implementation during the life cycle of projects from conception till customer satisfaction. Currently looking for a suitable Project Engineer or consultant position with a forward thinking employer.\nExperienceDesign Engineer at Jones and Carter Engineering firm,03/2014to11/2014General Dynamics–Vicksburg,MS,I work in land development department, my duties summarized by designing water and sewer lines, water and wastewater treatments, quantities take offs, CAD drafting, preparing submittals and bid books. Fluor enterprises Sep./2012-Sept. 2013 Assisted the Project Managers in the construction projects. Maintained the various drawings, log and specification in the construction project. Coordinated with the Project Managers and issued RFIs. Prepared the material procurement log and maintained records of all documents for the subcontractors. Prepared the monthly variance reports and maintained the quantity surveys. Received the bid packages and evaluated the bids. Organized the monthly invoices and facilitated the payments. Verified all the assemble change order submittals.Project Manager's Assistant,04/2006to07/2011Almco Group Of Companies–,,Managed all project files on the suppliers and subcontractors such as specifications and the built in records. Compiled the entire subcontractor's proposal and reviewed them thoroughly. Assisted the Project Manager and evaluated the work done by the subcontractor, prepared the project schedule. Coordinated with the Project Manager and ensured that the work was carried in accordance to the schedule and made the necessary changes. Maintained working relationship with the subcontractors, professionals, representatives and suppliers. Performed various office activities on the site, maintained all the project specific documents. Documented the progress of the construction process. Prepared and tracked all logs such as RFIs and submittals. Site Manager Performed under the supervision of the US Army Corps of Engineers and funded by US government, this work for the benefits of the ministry of justice. My duties were the general control and managements of the work in the field addition to my duties in the office as a site manager; I was responsible for the scheduling and updating the time schedule to reflect the progress in the work and percent's of the completions for the whole project. This work performed according to international standards and design drawings in the exact time according to time schedule. Field Engineer Site engineer in big project in Buca Camp, my duties briefly summarized in different types of constructions for overseeing workforce for a large construction project, involving variety of construction disciplines, including masonry, plumbing, steel erection and electrical work with all safety requirements.Field Engineer,04/2005to04/2006Al-Rafid Group Of Companies–,,Worked as a contract civil engineer with Al-Rafid group on a project with the Iraqi Ministry of Electricity and prime contractor Marubeni Corporation of Japan and subcontractors (BWSC) Burmeister and Wain Scandinavian Contractor A/S. The consultants on the project were Nippon Koie (NK). My duties included the construction of civil works (foundations (raft and separate footing), steel structure assembly, commencing the foundations of 132 Kva Towers, the Administration office ( building of one story concrete structure with masonry brick the area of facility is 756 m) and crew lodge multistory building concrete structure with masonry brick, area of the building is 216 m) Office engineer prepared most of the doc. related to the mentioned works as the daily reports and the method statements and the quality control reports, also I was the coordinator engineer with the subcontractor BWSC and attended many technical meetings with the consultant (NK) and the main contractor (Marubeni) in Amman. I was the engineer who makes the drawings of the Administration and crew lodge building and made the As-built drawings for all project.\nEducationMaster's:Civil Engineering,Expected in2015toUTA Grad School-,GPA:Master's Degree from UTA Grad School / Civil Engineering - Construction and Engineering Management:Arch,Expected in2013toCAD Institute-,GPA:Auto CAD, Civil and Architect (CAD Institute 2013) Primavera P6 2012 (USA) (fundamentals) Sage/ Timberline (Construction estimating) Revit (Arch. & Structural) software. (Basic level) ACI Concrete Field Testing Technician Grade 1, 2012, Expires 2017Bachelor:Civil Engineering,Expected in2003to-,GPA:Bachelor Degree in Civil Engineering, 2003\nSkillsEngineer, Masonry, Benefits, Field Engineer, Plumbing, Progress, Project Manager, Scheduling, Concrete, Assembly, Civil Engineer, Quality Control, Auto Cad, Cad, Analog Silicon, Cad Drafting, Design Engineer, Drafting, Invoices, Land Development, Payments, Procurement, Take Offs, Wastewater, Clients, Life Cycle, Project Engineer, Project Plans, Satisfaction, Civil Engineering, Construction Management, Training, Aci, Building Inspection, Construction Estimating, Estimating, Primavera, Suretrak, Testing, Timberline", 'We are currently recruiting for a power electronics engineer to work for a green technology start-up in Berkeley, California. \nWorking for a company who have recently closed a round of funding and are now looking at growing, you will be working for an engineering-led business where you will be involved in commercializing their core technology. They are looking for engineers that are happy to get involved in every aspect of the development lifecycle, who enjoy working with a broad range of technology, and who love solving problems. \nThe role is based full-time on-site in Berkeley, and the office is located close to a BART station.\nThe base salary for this role is in the region of $160k - $240k dependent on experience, plus equity and health coverage. \nThe role:\nAnalog design Power Electronics Board-level design, including component knowledgeHigh power high frequencySensor interfacesKnowledge of RF technologyCarry out design reviewsMentoring of junior engineers\nKnowledge of control systems andor mechatronics is a nice to have!\nPlease send in an up to date resume to apply.'],
    ['Professional ProfileClaire 6.1(CSA) from PegaSystems, Inc. Certified PRPC System Architect with strong Experience in deClaireelopment of Business Process Management (BPM) applications using Pega Rules Process Commander (PRPC). Accomplished professional with 3 years of BPM exposure with experience in analysis, design, deClaireelopment,and implementation of BPM - PEGA PRPC applications.\nQualificationsOperating Systems : Windows XP/2007/Win7Programming languages: JaClairea, Sql, HTML, Css,\nJaClaireaScript, XmlTools:\nPEGA (Pega Rules Processor Commander), Eclipse,\nNetBeansPackages: MS Office 2003/2007/2010BPM\nTools: PEGA (Pega Rules Processor Commander) 6.2\nand 7.1External certification: Pega PRPC Claire6.2 (CSA)\nCertified System Architect from PegasytemsInternal certifications: PEGA(L2.2),PEGA(L2.1) and\nJaClairea (L2.1)\nExperienceAssociate Software Engineer,06/2013-07/2016Ihs Markit–Us Remote,,HD Claireest Application process Description: Retail and AdClaireisory Account Opening Workflow, process that occurs when a new account needs to be established.Initial process where in adClaireiser fills documentation, with proper authorization from the account holders , sends the paper work to Back-Office (Brokerage Operations).Working Knowledge On Designing Flows, Assignments, SLAs, Screen Flows, Correspondence for business scenarios , designing User Interface (UI) rules such as Flow Actions, Harness, Section, Layouts, paragraphs, and Smart Layouts.Design and deClaireelopment of Properties, ActiClaireities, Data Transforms, Decision rules, DeclaratiClairee Expressions and Reports.Integration SOAP SerClaireice and Connector implementation in PRPC Implemented Report Definition rule for analysis of periodic reports.Dynamic Select and Circumstanced Section rules.Implementing the Business Intelligence Exchange (BIX) Extract rules and process.Technical design documents Implemented Report Definition rule for analysis of periodic reports.Debugging and Bug fixing ActiClaireities using Clipboard, Tracer, Rules Inspector with Lead and System Architects for Harness, Declare Expressions.QA Tester,08/2011-05/2013Newsmax Media–Boca Raton,,Understanding and analyzing test requirements.Claireerifying test enClaireironment.Contribution to test plan documentation.Creating test batches executing test cases and reporting defects.Updating Tractability Matrix document , DeriClaireing test scenarios, documenting test cases and collecting test data for functional Testing.Creating Test Batches, Executing Test Cases and Reporting Defects.Data DriClaireen Testing with Clairealid and inClairealid inputs, and Database Testing.Updating Test Cases and Test Data.Tracking changes preparing Reports and Updating Documents.IT Help desk | Hyderabad,01/2009-04/2011–,,ProClaireiding Help-desk support and resolClairee problems to the end users satisfaction Monitor and respond quickly and effectiClaireely to requests receiClaireed through the IT help-desk Monitor SerClaireice Desk for tickets assigned to the queue and process first-in first-out based on priority.Modify configurations, utilities, software default settings,etc.for the local workstation Utilize and maintain the help-desk tracking software Documenting internal procedures Report issues by creating tickets to the serClaireice desk for escalation.\nEducationBACHELOR OF TECHNOLOGY (B.TECH):Computer Science Engineering,Expected inJune 2011-JNTU UniClaireersity-Hyderabad,GPA:Status-Computer Science Engineering Related Courses OOPS through JaClairea, Database Management Systems, Web Technologies, Operating\nSystems, Algorithms.\nSkillsBusiness Intelligence, C, C++, Database, Database Management, Debugging, Designing, documentation, functional, Help-desk support, help-desk, Inspector, JaClairea, Back-Office, Exchange, Win7, Windows XP, OOPS, Operating Systems, Operating\nSystems, oracle sql, Programming, RDBMS, reporting, Retail, SOAP, User Interface, utilities, Workflow', "Robert Half is looking for a Senior Full Stack Engineer (PERN Stack) with experience in all parts of the modern software application stack. As a Full Stack Engineer, you will join a highly focused development team to design, build, and maintain end-to-end features of a desktop and mobile application. You will partner with other teams, such as our data science team, in order to build critical features for the company's users.\nExamples of critical business features you will be working on including payment integrations, application security, dynamic connections to third-party apps, custom data dashboards, productivity systems, and more. This is an opportunity to join a core team and make a meaningful impact.\nResponsibilities Implement application features given designs and documentation Maintain high-quality code that is performant and DRY Design reusable and performant front-end web components Transform large and complex datasets into beautiful visualizations Collaborate with technical leadership in order to design and implement secure and efficient APIs using RESTful design patterns Manage Software Development Life Cycle (SDLC) including monitoring and troubleshooting deployments throughout multiple environments\nTechnical Required Qualifications A minimum of 7-8 years of experience with the technologies of the PERN stack (PostgreSQL, Express, React, NodeJS) as well as Redux 7-8+ years of experience in general websoftware development, including both front end and back-end development Extensive experience with web application technologies such as HTML, CSS, JavaScript, JSON, Git, REST, Firebase, Material-UI, D3js, and other chart libraries Experience with Docker (Compose) Experience with AWS including some hands-on experience Proven record of shipping features on time and meeting tight deadlines Ability to communicate clearly in English on a day-to-day basis Organized and self-sufficient\nTechnical Preferred Qualifications Experience with OOP and Functional Programming practices 7-8+ years of software development experience Deep knowledge of TypeScript Bash scripting experience Experience writing and using DevOps tools Understanding CICD principles Familiarity with non-relational databases such as DynamoDB and Elasticsearch Excellent communication skills to collaborate with cross-functional partners and independently drive projects and decisions."],
]
scores = model.predict(pairs)
print(scores)
# [0.5905 0.7211 0.0022 0.9125 0.9458]

# Or rank different texts based on similarity to a single text
ranks = model.rank(
    "SummaryDynamic and motivated IT professional with around 7 years of experience as a Big Data Engineer with expertise in designing data intensive applications using Hadoop Ecosystem , Big Data Analytical , Cloud Data engineering , Data Warehouse / Data Mart, Data Visualization , Reporting , and Data Quality solutions .In - depth knowledge of Hadoop architecture and its components like YARN , HDFS, Name Node, Data Node, Job Tracker, Application Master, Resource Manager , Task Tracker and Map Reduce programming paradigm.Extensive experience in Hadoop led development of enterprise level solutions utilizing Hadoop components such as Apache Spark, MapReduce, HDFS, Sqoop, PIG, Hive, HBase, Oozie, Flume, NiFi, Kafka, Zookeeper, and YARN.Profound experience in performing Data Ingestion, Data Processing (Transformations, enrichment, and aggregations).Strong Knowledge on Architecture of Distributed systems and Parallel processing, In-depth understanding of MapReduce programming paradigm and Spark execution framework.Experienced with the Spark improving the performance and optimization of the existing algorithms in Hadoop using Spark Context , Spark-SQL , Dataframe API , Spark Streaming, MLlib , Pair RDD 's and worked explicitly on PySpark and Scala .Handled ingestion of data from different data sources into HDFS using Sqoop, Flume and perform transformations using Hive, Map Reduce and then loading data into HDFS.Managed Sqoop jobs with incremental load to populate HIVE external tables. Experience in importing streaming data into HDFS using Flume sources, and Flume sinks and transforming the data using Flume interceptors.Experience in Oozie and workflow scheduler to manage Hadoop jobs by Direct Acyclic Graph ( DAG ) of actions with control flows.Implemented the security requirements for Hadoop and integrating with Kerberos authentication infrastructure- KDC server setup, creating realm /domain, managing.Experience of Partitions, bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performance .Experience with different file formats like Avro , parquet , ORC , Json and XML .Expertise in Creating, Debugging, Scheduling and Monitoring jobs using Airflow and Oozie.Experienced with using most common Operators in Airflow - Python Operator, Bash Operator, Google Cloud Storage Download Operator, Google Cloud Storage Object Sensor.Hands-on experience in handling database issues and connections with SQL and NoSQL databases such as MongoDB , HBase , Cassandra , SQL server , and PostgreSQL .Created Java apps to handle data in MongoDB and HBase. Used Phoenix to create SQL layer on HBase.Experience in designing and creating RDBMS Tables, Views, User Created Data Types, Indexes, Stored Procedures, Cursors, Triggers and Transactions.Expert in designing ETL data flows using creating mappings/workflows to extract data from SQL Server and Data Migration and Transformation from Oracle/Access/Excel Sheets using SQL Server SSIS .Expert in designing Parallel jobs using various stages like Join, Merge, Lookup, remove duplicates, Filter, Dataset, Lookup file set, Complex flat file, Modify, Aggregator, XML.Hands-on experience with Amazon EC2, Amazon S3, Amazon RDS, VPC, IAM, Amazon Elastic Load Balancing, Auto Scaling, CloudWatch, SNS, SES, SQS, Lambda, EMR and other services of the AWS family.Created and configured new batch job in Denodo scheduler with email notification capabilities and Implemented Cluster setting for multiple Denodo node and created load balance for improving performance activity.Instantiated, created, and maintained CI/CD (continuous integration & deployment) pipelines and apply automation to environments and applications.Worked on various automation tools like GIT, Terraform, Ansible. Experienced in fact dimensional modeling ( Star schema, Snowflake schema ), transactional modeling and SCD (Slowly changing dimension)Experienced with JSON based RESTful web services, and XML/QML based SOAP web services and also worked on various applications using python integrated IDEs like Sublime Text and PyCharm .Efficient Cloud Engineer with years of experience assembling cloud infrastructure. Utilizes strong managerial skills by negotiating with vendors and coordinating tasks with other IT team members. Implements best practices to create cloud functions, applications and databases.\nSkills·Big Data Technologies:Hadoop, MapReduce, HDFS, Sqoop, PIG, Hive, HBase, Oozie, Flume, NiFi, Kafka, Zookeeper, Yarn, Apache Spark, Mahout, Sparklib·Databases:Oracle, MySQL, SQL Server, MongoDB, Cassandra, DynamoDB, PostgreSQL, Teradata, Cosmos.·Programming:Python, PySpark, Scala, Java, C, C++, Shell script, Perl script, SQL·Cloud Technologies:AWS, Microsoft Azure·Frameworks:Django REST framework, MVC, Hortonworks·Tools:PyCharm, Eclipse, Visual Studio, SQL*Plus, SQL Developer, TOAD, SQL Navigator, Query Analyzer, SQL Server Management Studio, SQL Assistance, Eclipse, Postman·Versioning tools:SVN, Git, GitHub·Operating Systems:Windows 7/8/XP/2008/2012, Ubuntu Linux, MacOS·Network Security:Kerberos·Database Modelling:Dimension Modeling, ER Modeling, Star Schema Modeling, Snowflake Modeling·Monitoring Tool:Apache Airflow·Visualization/ Reporting:Tableau, ggplot2, matplotlib, SSRS and Power BI·Machine Learning Techniques:Linear & Logistic Regression, Classification and Regression Trees, Random Forest, Associative rules, NLP and Clustering.\nExperienceAWS Data Engineer,01/2022-02/2022Deloitte–Ann Arbor,MI,Designed and setup Enterprise Data Lake to provide support for various uses cases including Analytics, processing, storing and Reporting of voluminous, rapidly changing dataResponsible for maintaining quality reference data in source by performing operations such as cleaning, transformation and ensuring Integrity in a relational environment by working closely with the stakeholders & solution architectDesigned and developed Security Framework to provide fine grained access to objects in AWS S3 using AWS Lambda, DynamoDBSet up and worked on Kerberos authentication principals to establish secure network communication on cluster and testing of HDFS, Hive, Pig and MapReduce to access cluster for new usersPerformed end- to-end Architecture & implementation assessment of various AWS services like Amazon EMR, Redshift, S3Implemented the machine learning algorithms using python to predict the quantity a user might want to order for a specific item so we can automatically suggest using kinesis firehose and S3 data lakeUsed AWS EMR to transform and move large amounts of data into and out of other AWS data stores and databases, such as Amazon Simple Storage Service (Amazon S3) and Amazon DynamoDBUsed Spark SQL for Scala & amp, Python interface that automatically converts RDD case classes to schema RDDImport the data from different sources like HDFS/HBase into Spark RDD and perform computations using PySpark to generate the output responseCreating Lambda functions with Boto3 to deregister unused AMIs in all application regions to reduce the cost for EC2 resourcesImporting & exporting database using SQL Server Integrations Services (SSIS) and Data Transformation Services (DTS Packages)Coded Teradata BTEQ scripts to load, transform data, fix defects like SCD 2 date chaining, cleaning up duplicatesDeveloped reusable framework to be leveraged for future migrations that automates ETL from RDBMS systems to the Data Lake utilizing Spark Data Sources and Hive data objectsConducted Data blending, Data preparation using Alteryx and SQL for Tableau consumption and publishing data sources to Tableau serverDeveloped Kibana Dashboards based on the Log stash data and Integrated different source and target systems into Elasticsearch for near real time log analysis of monitoring End to End transactionsImplemented AWS Step Functions to automate and orchestrate the Amazon SageMaker related tasks such as publishing data to S3, training ML model and deploying it for predictionIntegrated Apache Airflow with AWS to monitor multi-stage ML workflows with the tasks running on Amazon SageMakerEnvironment: AWS EMR, S3, RDS, Redshift, Lambda, Boto3, DynamoDB, Amazon SageMaker, Apache Spark, HBase, Apache Kafka, HIVE, SQOOP, Map Reduce, Snowflake, Apache Pig, Python, SSRS, TableauAssessed organization technology infrastructure and managed cloud migration process.Configured computing, networking and security systems within cloud environment.Implemented cloud policies, managed technology requests and maintained service availability.Data Engineer,01/2016-11/2019Honeywell–Huntsville,AL,Worked on Azure Data Factory to integrate data of both on-prem (MY SQL, Cassandra) and cloud (Blob storage, Azure SQL DB) and applied transformations to load back to Azure SynapseManaged, Configured and scheduled resources across the cluster using Azure Kubernetes ServiceMonitored Spark cluster using Log Analytics and Ambari Web UITransitioned log storage from Cassandra to Azure SQL Datawarehouse and improved the query performanceInvolved in developing data ingestion pipelines on Azure HDInsight Spark cluster using Azure Data Factory and Spark SQLAlso Worked with Cosmos DB (SQL API and Mongo API)Develop dashboards and visualizations to help business users analyze data as well as providing data insight to upper management with a focus on Microsoft products like SQL Server Reporting Services (SSRS) and Power BIPerformed the migration of large data sets to Databricks (Spark), create and administer cluster, load data, configure data pipelines, loading data from ADLS Gen2 to Databricks using ADF pipelinesCreated various pipelines to load the data from Azure data lake into Staging SQLDB and followed by to Azure SQL DBCreated Databrick notebooks to streamline and curate the data for various business use cases and also mounted blob storage on DatabrickUtilized Azure Logic Apps to build workflows to schedule and automate batch jobs by integrating apps, ADF pipelines, and other services like HTTP requests, email triggers etcWorked extensively on Azure data factory including data transformations, Integration Runtimes, Azure Key Vaults, Triggers and migrating data factory pipelines to higher environments using ARM TemplatesIngested data in mini-batches and performs RDD transformations on those mini-batches of data by using Spark Streaming to perform streaming analytics in Data bricksEnvironment: Azure SQL DW, Databrick, Azure Synapse, Cosmos DB, ADF, SSRS, Power BI, Azure Data lake, ARM, Azure HDInsight, Blob storage, Apache Spark.Adept in troubleshooting and identifying current issues and providing effective solutions.Managed performance monitoring and tuning while identifying and repairing issues within database realm.Identified key use cases and associated reference architectures for market segments and industry verticals.Designed surveys, opinion polls, and assessment tools to collect data.Tested, validated and reformulated models to foster accurate prediction of outcomes.Created graphs and charts detailing data analysis results.Recommended data analysis tools to address business issues.Developed new functions and applications to conduct analyses.Cleaned and manipulated raw data.Collaborated with solution architects to define database and analytics engagement strategies for operational territories and key accounts.Big Data Engineer / Hadoop Developer,10/2013-12/2015Infosys Ltd–Irwindale,CA,AnsibleDenodoDenodoCloudWatchAvroPySparkPySparkPySparkMLlibDataframeNiFiNiFiInteracted with business partners, Business Analysts and product owner to understand requirements and build scalable distributed data solutions using Hadoop ecosystemDeveloped Spark Streaming programs to process near real time data from Kafka, and process data with both stateless and state full transformationsWorked with HIVE data warehouse infrastructure-creating tables, data distribution by implementing partitioning and bucketing, writing and optimizing the HQL queriesBuilt and implemented automated procedures to split large files into smaller batches of data to facilitate FTP transfer which reduced 60% of execution timeWorked on developing ETL processes (Data Stage Open Studio) to load data from multiple data sources to HDFS using FLUME and SQOOP, and performed structural modifications using Map Reduce, HIVED eveloping Spark scripts, UDFS using both Spark DSL and Spark SQL query for data aggregation, querying, and writing data back into RDBMS through SqoopWritten multiple MapReduce Jobs using Java API, Pig and Hive for data extraction, transformation and aggregationAvrom multiple file formats including Parquet, Avro, XML, JSON, CSV, ORCFILE and other compressed file formats Codecs like gZip, Snappy, LzoStrong understanding of Partitioning, bucketing concepts in Hive and designed both Managed and External tables in Hive to optimize performanceDeveloped PIG UDFs for manipulating the data according to Business Requirements and also worked on developing custom PIG LoadersDeveloping ETL pipelines in and out of data warehouse using combination of Python and Snowflakes SnowSQL Writing SQL queries against SnowflakeExperience in report writing using SQL Server Reporting Services (SSRS) and creating various types of reports like drill down, Parameterized, Cascading, Conditional, Table, Matrix, Chart and Sub ReportsUsed DataStax Spark connector which is used to store the data into Cassandra database or get the data from Cassandra databaseWrote oozie scripts and setting up workflow using Apache Oozie workflow engine for managing and scheduling Hadoop jobsWorked on implementation of a log producer in Scala that watches for application logs, transform incremental log and sends them to a Kafka and Zookeeper based log collection platformUsed Hive to analyze data ingested into HBase by using Hive-HBase integration and compute various metrics for reporting on the dashboardTransformed tPySpark using AWS Glue dynamic frames with PySpark; cataloged the transformed the data using Crawlers and scheduled the job and crawler using workflow featureWorked on installing cluster, commissioning & decommissioning of data node, name node recovery, capacity planning, and slots configurationDeveloped data pipeline programs with Spark Scala APIs, data aggregations with Hive, and formatting data (JSON) for visualization, and generatiPySparkEnvironment: AWS, Cassandra, PySpark, Apache Spark, HBase, Apache Kafka, HIVE, SQOOP, FLUME, Apache oozie, Zookeeper, ETL, UDF, Map Reduce, Snowflake, Apache Pig, Python, Java, SSRSOnfidentialDeveloped and implemented Hadoop code while observing coding standards.Optimized and tuned Hadoop environments and modified hardware to meet prescribed performance thresholds.Developed new functions and applications to conduct analyses.Created graphs and charts detailing data analysis results.Tested, validated and reformulated models to foster accurate prediction of outcomes.Python Developer,09/2012-10/2013Fiserv–City,STATE,AWS, S3, EC2, LAMBDA, EBS, IAM, Datadog, CloudTrail, CLI, Ansible, MySQL, Python, Git, Jenkins, DynamoDB, Cloud Watch, Docker, KubernetesLeveraged open communication, collective decision-making and thorough reviews to create performant and scalable systems.Worked with server-side and front-end technologies and leveraged common design patterns to code dynamic and user-friendly systems.Implemented new API routes, architected new ORM structures and refactored code to boost application performance.Harnessed version control tools to coordinate project development and individual code submissions.Introduced cloud-based technologies into Python development to expand on-premise deployment options.Wrote clear and clean code for use in projects.Resolved customer issues by establishing workarounds and solutions to debug and create defect fixes.\nEducation and TrainingMaster of Science:Data Engineering,Expected in05/2023-George Mason University-Fairfax,VAGPA:Status-Bachelor of Engineering:Computer Networking And Telecommunications,Expected in05/2019-University of Mumbai-India,GPA:Status-",
    [
        'RoleGaming Business AnalystResponsibilities Ability to understand vast amounts of data, identify and fix data issues Strong in database and Data Warehousing concepts Strong in TSQL Data analysis and presentation Data insight generation Strong reporting using Power BI, Power Apps & Excel Ability to succeed in a fast-paced, dynamic business environment Excellent technical & analytical skills with strong business acumen Strong communication skillsRequired SkillsProven experience as a Gaming Domain Expert, Game Analyst, or similar role within the gaming industry.Passion about gaming and a genuine interest in the gaming industry.Strong communication and presentation skills to effectively convey research findings to both technical and non-technical stakeholders.Strong analytical skills and ability to interpret complex data sets to derive meaningful insights.Should be able to do the qualitative and quantitative Research on gaming data such as competitor trends, product performance, consumers, games, and acquisitions .Excellent research abilities, with a proactive approach to stay updated on industry developments.Must have Deep understanding of Gaming Industry trends to perform ad-hoc analysis and research across a broad range of industries.Deep knowledge and understanding of gaming platforms, game genres, player behavior, and industry trends, patterns, and insights for game console, games, and subscriptions across all gaming companies.Analyze internal game meta data and KPIs and helping in curating the game, genre, publisher, developer etc.Identify key takeaways based on research, prepare presentations, communicate with business stakeholders.Should be able to build the forecasting model for any game or game franchise.Perform Market studies, consumer insights, competitive analysis, ad hoc reporting, and market trends across the gaming and game development industries.Basic Understanding of T-SQLFamiliarity with data analysis tools and techniques.Should be able to create the pivots in Excel from Relational models for slice and dice the data.Ability to understand vast amounts of data.Identify and fix data issues ,Data analysis and presentation ,Data insight generation.Ability to thrive in a fast-paced, dynamic business environment ,Excellent technical & analytical skills with strong business acumen ,Strong communication skills,SQL, ExcelGood to have skillsDigital : PythonExperience Required (in Yrs.)5+ YearsWork LocationBellevue, USA',
        'Job Title: Senior AccountantLocation: Atlanta, GA (Hybrid)Duration: 12+ Months (Contract)\nThe candidate will assist in  be responsible for:Day-to-day general ledger accounting, including journal entry preparation and related reporting in the areas of Prepaids, Accruals, Payroll, Benefits, and Intercompany  Related Party processes.Assist in the monthly accounting close procedures including proper period end cut-off and accounting close schedule.Calculating and maintaining payroll related and cost accruals to ensure accurate monthly cut off.Monitoring elements leading to cross margin  profitability analysis and support to project management.Maintenance of chart of accounts and cost center reporting.\nQualifications:Bachelors degree in accounting or finance (concentration in Accounting) preferred.10+ years of accounting experience (General Ledger, AR, AP, Cash Management).5+ years of financial analysis.Audit background a plus.Experience working in an international and cross-cultural environment.Experience with SAPR3 or S4 (FI) required.Experience with SAP BW, SAP CRM is a plus.Proficiency in knowledge of US GAAP, IFRS Accounting, and US Tax.Strong PC skills with advanced knowledge in Excel and PPT.',
        'As a Solution Architect - Data Engineering, you will work for an American multinational technology company focusing on various technological domains such as artificial intelligence, online advertising, search engine technology, cloud computing, computer software, quantum computing, e-commerce, and consumer electronics. The job requires expertise in Databricks, a cloud-based data engineering platform.\nKey responsibilities:Provide technical leadership in a post-sales capacity to guide strategic customers as they design and implement big data projects, ranging from architectural design to data engineering to model deployment.Identify and drive new initiatives that enable customers to turn their data into actionable business value and align these initiatives with their business outcomes for continued success.Architect production-level workloads, including end-to-end pipeline load performance testing and optimization.Deliver tutorials and training to drive community adoption (including hackathons, conference presentations, etc.)Work closely with Engineering and Product Management to drive the direction of the Databricks product.Contribute to Databricks SME community. Required SkillsHands-on and technical expertise with Apache SparkProven experience of design and implementation experience in big data technologies including Hadoop, NoSQL, MPP, OLTP, OLAP5+ years Experience working as either: Software EngineerData Engineer: query tuning, performance tuning, troubleshooting, and debugging Spark andor other big data solutions.Comfortable programming in Python, Scala, or JavaExperience using and designing solutions on cloud infrastructure and services, such as AWS, Azure, or GCPExperience with Development Tools for CICD, Unit and Integration testing, Automation and Orchestration, REST API, BI tools, and SQL Interfaces. E.g. Jenkins.Excellent communication skills and comfortable presenting to strategic stakeholdersleadership.Experience in customer-facing pre-sales, post-sales, technical architecture guidance, or consulting.Passionate about learning new technologies and making customers successfulData ScienceML Engineer experience in model selection, model lifecycle, hyper-parameter tuning, model serving, and deep learning, using tools like MLFlow desired.\n Life at CapgeminiCapgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:Flexible workHealthcare, including dental, vision, mental health, and well-being programsFinancial well-being programs such as 401(k) and Employee Share Ownership PlanPaid time off and paid holidaysPaid parental leaveFamily-building benefits like adoption assistance, surrogacy, and cryopreservationSocial well-being benefits like subsidized backup childelder care and tutoringMentoring, coaching, and learning programsEmployee Resource GroupsDisaster Relief',
        'We are currently recruiting for a power electronics engineer to work for a green technology start-up in Berkeley, California. \nWorking for a company who have recently closed a round of funding and are now looking at growing, you will be working for an engineering-led business where you will be involved in commercializing their core technology. They are looking for engineers that are happy to get involved in every aspect of the development lifecycle, who enjoy working with a broad range of technology, and who love solving problems. \nThe role is based full-time on-site in Berkeley, and the office is located close to a BART station.\nThe base salary for this role is in the region of $160k - $240k dependent on experience, plus equity and health coverage. \nThe role:\nAnalog design Power Electronics Board-level design, including component knowledgeHigh power high frequencySensor interfacesKnowledge of RF technologyCarry out design reviewsMentoring of junior engineers\nKnowledge of control systems andor mechatronics is a nice to have!\nPlease send in an up to date resume to apply.',
        "Robert Half is looking for a Senior Full Stack Engineer (PERN Stack) with experience in all parts of the modern software application stack. As a Full Stack Engineer, you will join a highly focused development team to design, build, and maintain end-to-end features of a desktop and mobile application. You will partner with other teams, such as our data science team, in order to build critical features for the company's users.\nExamples of critical business features you will be working on including payment integrations, application security, dynamic connections to third-party apps, custom data dashboards, productivity systems, and more. This is an opportunity to join a core team and make a meaningful impact.\nResponsibilities Implement application features given designs and documentation Maintain high-quality code that is performant and DRY Design reusable and performant front-end web components Transform large and complex datasets into beautiful visualizations Collaborate with technical leadership in order to design and implement secure and efficient APIs using RESTful design patterns Manage Software Development Life Cycle (SDLC) including monitoring and troubleshooting deployments throughout multiple environments\nTechnical Required Qualifications A minimum of 7-8 years of experience with the technologies of the PERN stack (PostgreSQL, Express, React, NodeJS) as well as Redux 7-8+ years of experience in general websoftware development, including both front end and back-end development Extensive experience with web application technologies such as HTML, CSS, JavaScript, JSON, Git, REST, Firebase, Material-UI, D3js, and other chart libraries Experience with Docker (Compose) Experience with AWS including some hands-on experience Proven record of shipping features on time and meeting tight deadlines Ability to communicate clearly in English on a day-to-day basis Organized and self-sufficient\nTechnical Preferred Qualifications Experience with OOP and Functional Programming practices 7-8+ years of software development experience Deep knowledge of TypeScript Bash scripting experience Experience writing and using DevOps tools Understanding CICD principles Familiarity with non-relational databases such as DynamoDB and Elasticsearch Excellent communication skills to collaborate with cross-functional partners and independently drive projects and decisions.",
    ]
)
# [{'corpus_id': ..., 'score': ...}, {'corpus_id': ..., 'score': ...}, ...]

Evaluation

Metrics

Cross Encoder Binary Classification

Evaluated with CEBinaryClassificationEvaluator

Metric	Value
accuracy	0.6947
accuracy_threshold	0.3099
f1	0.7569
f1_threshold	0.07
precision	0.634
recall	0.939
average_precision	0.6919

Training Details

Training Dataset

Unnamed Dataset

Size: 6,241 training samples
Columns: sentence_0, sentence_1, and label

Approximate statistics based on the first 1000 samples:

	sentence_0	sentence_1	label
type	string	string	float
details	min: 324 tokens mean: 507.24 tokens max: 512 tokens	min: 17 tokens mean: 379.85 tokens max: 512 tokens	min: 0.0 mean: 0.49 max: 1.0

Samples:

sentence_0	sentence_1	label
SummaryDynamic and motivated IT professional with around 7 years of experience as a Big Data Engineer with expertise in designing data intensive applications using Hadoop Ecosystem , Big Data Analytical , Cloud Data engineering , Data Warehouse / Data Mart, Data Visualization , Reporting , and Data Quality solutions .In - depth knowledge of Hadoop architecture and its components like YARN , HDFS, Name Node, Data Node, Job Tracker, Application Master, Resource Manager , Task Tracker and Map Reduce programming paradigm.Extensive experience in Hadoop led development of enterprise level solutions utilizing Hadoop components such as Apache Spark, MapReduce, HDFS, Sqoop, PIG, Hive, HBase, Oozie, Flume, NiFi, Kafka, Zookeeper, and YARN.Profound experience in performing Data Ingestion, Data Processing (Transformations, enrichment, and aggregations).Strong Knowledge on Architecture of Distributed systems and Parallel processing, In-depth understanding of MapReduce programming paradigm and Spark...	RoleGaming Business AnalystResponsibilities Ability to understand vast amounts of data, identify and fix data issues Strong in database and Data Warehousing concepts Strong in TSQL Data analysis and presentation Data insight generation Strong reporting using Power BI, Power Apps & Excel Ability to succeed in a fast-paced, dynamic business environment Excellent technical & analytical skills with strong business acumen Strong communication skillsRequired SkillsProven experience as a Gaming Domain Expert, Game Analyst, or similar role within the gaming industry.Passion about gaming and a genuine interest in the gaming industry.Strong communication and presentation skills to effectively convey research findings to both technical and non-technical stakeholders.Strong analytical skills and ability to interpret complex data sets to derive meaningful insights.Should be able to do the qualitative and quantitative Research on gaming data such as competitor trends, product performance, consumers,...	`1.0`
`Summary8+ years of accomplished experience in the field of accounting Team and organizational training from a major global public corporation Exceptionally fast, efficient and organized Knowledge of all accounting functions: GL, PL, and BS - budgets, forecasting, variance analysis, trend analysis, financial reporting, reconciliations, work papers, journal entries, accruals, AP, AR Experience in GAAP and Statutory accounting and monthly and year-end closing processes`
HighlightsOracle Financial, PeopleSoft, Microsoft Dynamics Nav, Microsoft Office Suite, Outlook, Lotus Notes
Experience06/2015toPresentSenior AccountantGartner	Redwood City,CA,Prepare, examine, or analyze accounting records, financial statements, or other financial reports to assess accuracy, completeness, and conformance to reporting and procedural standards.Process, prepare and maintain reporting related to Inventory, and all associated recurring and/or ad hoc journal entries, account analysis, financial reporting, accoun...	`Job Title: Senior AccountantLocation: Atlanta, GA (Hybrid)Duration: 12+ Months (Contract)`
The candidate will assist in be responsible for:Day-to-day general ledger accounting, including journal entry preparation and related reporting in the areas of Prepaids, Accruals, Payroll, Benefits, and Intercompany Related Party processes.Assist in the monthly accounting close procedures including proper period end cut-off and accounting close schedule.Calculating and maintaining payroll related and cost accruals to ensure accurate monthly cut off.Monitoring elements leading to cross margin profitability analysis and support to project management.Maintenance of chart of accounts and cost center reporting.
Qualifications:Bachelors degree in accounting or finance (concentration in Accounting) preferred.10+ years of accounting experience (General Ledger, AR, AP, Cash Management).5+ years of financial analysis.Audit background a plus.Experience working in an international and cross-cultural enviro...	`1.0`
`SummaryHighly motivated Sales Associate with extensive customer service and sales experience. Outgoing sales professional with track record of driving increased sales, improving buying experience and elevating company profile with target market.`
SkillsTimberline, MRI, YARDI, Peachtree, Peoplesoft, OneSite, QuickBooks
Microsoft Word and Excel
Experience07/2014toPresentACCOUNTANTArizona State University–Tempe,AZ,I am an experienced and goal-oriented Accountant with a demonstrated track record in preparation and analysis of financial reports to summarize and forecast financial position.Independent contributor committed to superior quality, teamwork and proficient internal and external customer service.An Accountant experienced in driving efficiency, productivity, and implementation of process improvements to support achievement of overall corporate goals and objectives.Core competencies include:.Accounting Management.Cash Management FDH Velocitel provides all the services needed to design...	`As a Solution Architect - Data Engineering, you will work for an American multinational technology company focusing on various technological domains such as artificial intelligence, online advertising, search engine technology, cloud computing, computer software, quantum computing, e-commerce, and consumer electronics. The job requires expertise in Databricks, a cloud-based data engineering platform.`
Key responsibilities:Provide technical leadership in a post-sales capacity to guide strategic customers as they design and implement big data projects, ranging from architectural design to data engineering to model deployment.Identify and drive new initiatives that enable customers to turn their data into actionable business value and align these initiatives with their business outcomes for continued success.Architect production-level workloads, including end-to-end pipeline load performance testing and optimization.Deliver tutorials and training to drive community adoption (including hack...	`0.0`

Loss: BinaryCrossEntropyLoss with these parameters:

{
    "activation_fn": "torch.nn.modules.linear.Identity",
    "pos_weight": null
}

Training Hyperparameters

Non-Default Hyperparameters

per_device_train_batch_size: 16
per_device_eval_batch_size: 16

All Hyperparameters

Click to expand

per_device_train_batch_size: 16
num_train_epochs: 3
max_steps: -1
learning_rate: 5e-05
lr_scheduler_type: linear
lr_scheduler_kwargs: None
warmup_steps: 0
optim: adamw_torch
optim_args: None
weight_decay: 0.0
adam_beta1: 0.9
adam_beta2: 0.999
adam_epsilon: 1e-08
optim_target_modules: None
gradient_accumulation_steps: 1
average_tokens_across_devices: True
max_grad_norm: 1
label_smoothing_factor: 0.0
bf16: False
fp16: False
bf16_full_eval: False
fp16_full_eval: False
tf32: None
gradient_checkpointing: False
gradient_checkpointing_kwargs: None
torch_compile: False
torch_compile_backend: None
torch_compile_mode: None
use_liger_kernel: False
liger_kernel_config: None
use_cache: False
neftune_noise_alpha: None
torch_empty_cache_steps: None
auto_find_batch_size: False
log_on_each_node: True
logging_nan_inf_filter: True
include_num_input_tokens_seen: no
log_level: passive
log_level_replica: warning
disable_tqdm: False
project: huggingface
trackio_space_id: trackio
per_device_eval_batch_size: 16
prediction_loss_only: True
eval_on_start: False
eval_do_concat_batches: True
eval_use_gather_object: False
eval_accumulation_steps: None
include_for_metrics: []
batch_eval_metrics: False
save_only_model: False
save_on_each_node: False
enable_jit_checkpoint: False
push_to_hub: False
hub_private_repo: None
hub_model_id: None
hub_strategy: every_save
hub_always_push: False
hub_revision: None
load_best_model_at_end: False
ignore_data_skip: False
restore_callback_states_from_checkpoint: False
full_determinism: False
seed: 42
data_seed: None
use_cpu: False
accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
parallelism_config: None
dataloader_drop_last: False
dataloader_num_workers: 0
dataloader_pin_memory: True
dataloader_persistent_workers: False
dataloader_prefetch_factor: None
remove_unused_columns: True
label_names: None
train_sampling_strategy: random
length_column_name: length
ddp_find_unused_parameters: None
ddp_bucket_cap_mb: None
ddp_broadcast_buffers: False
ddp_backend: None
ddp_timeout: 1800
fsdp: []
fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
deepspeed: None
debug: []
skip_memory_metrics: True
do_predict: False
resume_from_checkpoint: None
warmup_ratio: None
local_rank: -1
prompts: None
batch_sampler: batch_sampler
multi_dataset_batch_sampler: proportional
router_mapping: {}
learning_rate_mapping: {}

Training Logs

Epoch	Step	Training Loss	average_precision
1.0	391	-	0.6340
1.2788	500	0.6301	-
2.0	782	-	0.6985
2.5575	1000	0.4634	-
3.0	1173	-	0.6919

Training Time

Training: 3.4 hours

Framework Versions

Python: 3.10.0
Sentence Transformers: 5.4.1
Transformers: 5.5.4
PyTorch: 2.5.1+cu121
Accelerate: 1.13.0
Datasets: 4.8.4
Tokenizers: 0.22.2

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}