Skip to content

Commit 532b020

Browse files
CodemodService Botfacebook-github-bot
authored andcommitted
Fix CQS signal facebook-unused-include-check in fbcode/pytorch/tokenizers (#115)
Summary: Pull Request resolved: #115 Reviewed By: q10 Differential Revision: D78325189
1 parent 287ef1a commit 532b020

File tree

3 files changed

+1
-10
lines changed

3 files changed

+1
-10
lines changed

src/regex_lookahead.cpp

Lines changed: 1 addition & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,11 @@
1-
/*
2-
* Copyright (c) Meta Platforms, Inc. and affiliates.
3-
* All rights reserved.
4-
*
5-
* This source code is licensed under the BSD-style license found in the
6-
* LICENSE file in the root directory of this source tree.
7-
*/
1+
// (c) Meta Platforms, Inc. and affiliates. Confidential and proprietary.
82

93
// This file contains the implementation of create_regex with lookahead support
104

115
#include <pytorch/tokenizers/pcre2_regex.h>
126
#include <pytorch/tokenizers/regex.h>
137
#include <pytorch/tokenizers/std_regex.h>
148

15-
#include <iostream>
169
#include <memory>
1710

1811
namespace tokenizers {

src/tiktoken.cpp

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,6 @@
2828
#include <pytorch/tokenizers/base64.h>
2929
#include <pytorch/tokenizers/tiktoken.h>
3030
#include <algorithm>
31-
#include <cinttypes>
3231
#include <fstream>
3332
#include <limits>
3433
#include <unordered_set>

test/test_regex.cpp

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,7 +9,6 @@
99
#include <gtest/gtest.h>
1010

1111
#include "pytorch/tokenizers/pcre2_regex.h"
12-
#include "pytorch/tokenizers/re2_regex.h"
1312
#include "pytorch/tokenizers/regex.h"
1413

1514
using namespace tokenizers;

0 commit comments

Comments
 (0)